Tag: machine-learning

Discussion of the challenging job market for ML researchers, highlighting a disconnect between academic achievement and industry hiring. Despite strong publications at top venues, breaking into big tech remains difficult.

Experimental architecture called "Strawberry" trained from scratch with only 1.8M parameters. Despite tiny size, demonstrates interesting architectural explorations in the local model space.

Questions the massive infrastructure investments by big tech given apparent plateauing in LLM improvements. References research on AI incoherence and the limits of current approaches.

MIT researchers developed silicon chips that perform calculations using heat flow rather than electrical signals, with temperature differences acting as data. The porous silicon architecture is algorithmically designed so heat follows precise paths enabling matrix-vector multiplication, a core AI operation. The technology converts waste heat into computation.

Fudan University researchers developed flexible fiber chips 50-70 micrometers thick that survive being crushed by 15.6-ton vehicles. The "sushi roll" design integrates 100,000 transistors per centimeter with a one-meter strand offering processing power comparable to classic CPUs. The technology enables computing in textiles and extreme environments.

DeepMind's Aletheia agent, powered by Gemini Deep Think, reportedly solved a research-level mathematics problem (Erdős-1051) autonomously through iterative generation, verification, and revision. The "superhuman" repository contains prompts and outputs demonstrating the agent's reasoning process on problems beyond typical benchmark tasks.

Senior ML researcher (throwaway account) argues that senior researchers have quietly outsourced educational/mentorship responsibilities to social media, caring almost exclusively about publications. This year's ICLR mess isn't just about OpenReview leaks or AC overload - it's a systemic failure to train researchers properly.

Developer won Dell DGX Spark GB10 at Nvidia hackathon, previously only used for inferencing Nemotron 30B (100+ GB memory). Asking community for recommendations on fine-tuning and optimal use cases. Community engagement shows enthusiasm for helping maximize the hardware.

Discussion of why the Sinkhorn-Knopp algorithm for creating doubly stochastic matrices (preventing gradient vanishing/explosion) only gained attention with DeepSeek's mHC paper despite being known for decades. The technique helps maintain gradient stability across layers but wasn't emphasized in earlier RNN work.

Boston Dynamics and Google DeepMind announced formal partnership to bring foundational AI intelligence to humanoid robots. Combines Boston Dynamics' hardware excellence with DeepMind's AI capabilities for next-generation robotics.

DeepSeek's latest research extends the residual connection paradigm that has dominated deep learning for a decade. The mHC architecture expands residual stream width and provides new theoretical foundations for understanding neural network information flow, potentially influencing future model architectures.

Community member preparing a multi-GPU Intel Arc setup for AI training, representing growing interest in alternative hardware platforms beyond NVIDIA. This signals increasing diversification in GPU options for AI workloads as Intel's software stack matures.

Departing Meta AI chief Yann LeCun confirms long-suspected benchmark manipulation for Llama 4, revealing internal tensions at Meta over AI development direction. This raises important questions about benchmark integrity and corporate AI development practices.

Successful debugging and optimization of a Deep Convolutional GAN implementation, with community discussion around architecture optimization for resource-constrained training. Shows continued relevance of classical generative approaches.