Tag: machine-learning

OpenAI reports that a new internal model, which began training on August 28, has solved over 100 long-standing open mathematical problems across multiple fields in just 24 days. This includes work on the Navier-Stokes Millennium Prize Problem. The pace has surprised even OpenAI's own mathematicians, suggesting AI capabilities may be entering a fundamentally different phase.

Alibaba announced plans to build AI models with 5-10 trillion parameters, alongside new custom chip designs. This follows their Qwen 4 announcement and represents a significant scale-up from current models. The announcement signals continued heavy investment in AI infrastructure and model development from Chinese tech companies.

A reality check on the local AI community's hardware expectations. While enthusiast setups with multiple GPUs and 24GB+ VRAM dominate discussions, 12-16GB represents the practical ceiling for most users globally. This has significant implications for model development priorities and accessibility.

OpenAI's new internal model, which began training just 24 days ago on August 28, has already solved 100+ long-standing mathematical problems. The pace is surprising even to OpenAI's mathematicians. This suggests the bottleneck is shifting from "Can AI solve this?" to "Which problems should AI solve?" and "Can humans keep up with verification?"

OpenAI is rapidly expanding robotics hiring after shutting down their robotics division in 2020. This signals a re-entry into physical AI and suggests humanoids/robotics is becoming the next major competitive frontier alongside Tesla, Figure, and Google DeepMind.

A paper argues RSI (recursive self-improvement) is not imminent because current agents cannot complete open-ended ML research tasks. The study had agents attempt to reproduce accepted NeurIPS papers, which were then graded by original authors—agents failed to complete the work.

Significant progress toward solving the Navier-Stokes Millennium Problem, with Terence Tao noting "there does not seem to be anything in principle preventing the methods from extending all the way to Navier-Stokes." This represents potential AI-assisted breakthrough on one of the seven Millennium Prize Problems, showing AI's expanding capability in mathematical research.

The AI community is grappling with the rapid acceleration from achieving gold medals on International Math Olympiad problems to making serious progress on Millennium Prize Problems in under a year. This timeline compression is forcing reconsideration of what constitutes "stochastic parrots" versus genuine reasoning capabilities.

NVIDIA's acquisition price of Hugging Face encodes the 🤗 emoji (U+1F917) in its first digits. Beyond the clever easter egg, this massive acquisition signals NVIDIA's strategic move to control the distribution infrastructure for open-source AI models, potentially reshaping the landscape of model sharing and deployment.

Third-year PhD student reflects on increasingly relying on Claude Code for research work—from boilerplate to experiment scaffolding, dataloader refactoring, and analysis scripts. Questions whether this represents genuine productivity or erosion of technical fundamentals.

Research paper introducing ToMoE, a method for converting dense LLMs to Mixture-of-Experts architecture through dynamic structural pruning. Offers a path to make existing dense models more efficient for deployment without full retraining.

A detailed write-up of training a 1.1B parameter model from scratch on 20B tokens (fineweb-edu) for ~$200, then fine-tuning with LoRA for chat. This demonstrates that pre-training is increasingly accessible to individuals, not just large labs.

A researcher compiled the grade-school multiplication algorithm directly into a Phi-3 checkpoint using "Torchwright," achieving 100% accuracy on all 3M supported expressions without training. This demonstrates that transformers *can* do exact arithmetic when weights are chosen correctly—the limitation is learning, not architecture.

ML reviewer observes only 1 of 12 papers reviewed provided runnable code, with 7 providing no code at all. Calls for mandatory full reproduction code as desk rejection criterion. The reproducibility crisis in ML research continues to worsen.

Assistant professor reports losing talented undergraduates to industry after experiencing the ML conference review process. Students cite frustration with arbitrary rejections and adversarial reviewers as reason to avoid academia. The review culture is driving talent away from research.

During a live demonstration of Qualcomm's new AI chip, the robot being showcased failed completely mid-presentation. While embarrassing for Qualcomm, this incident serves as a reminder that AI hardware and robotics remain challenging engineering problems despite rapid progress. The moment became viral as a cautionary tale about overpromising in AI product launches.

Analysis challenging claims that Chinese models like Kimi K3 achieve their performance primarily through distillation from Western models. The author examines model preference matrices and finds patterns inconsistent with simple distillation, particularly noting that GPT models don't "like" themselves while Opus and Gemini models show cross-preference. This suggests more sophisticated training approaches than mere distillation.

GPT-5.6 Sol solved another long-standing mathematical problem from Erdős, continuing the recent trend of frontier AI models making breakthroughs on decades-old unsolved problems. This follows similar recent breakthroughs, suggesting we're reaching an inflection point where AI can contribute meaningfully to frontier mathematical research.

The father of reinforcement learning launched Oak Lab to pursue his "OaK" architecture for AGI, focusing on continuous learning from experience rather than pre-training. The goal of trillion-parameter agents running on 20 watts represents a radically different approach from current scaling paradigms.

1X revealed NEO's robotic hands with 25 degrees of freedom using tendon-driven quasi-direct-drive motors with low gear ratios (5:1 to 15:1 vs typical 100:1-200:1). Motors positioned in the forearm keep the hand lightweight while producing high forces, with comprehensive force/position/tactile sensing.

Using Anthropic's newly released Jacobian-Lens tool, a researcher created a tool to manually modify model behavior by tweaking the Jacobian space and exporting modified models. This enables human-guided abliteration and behavior modification without fine-tuning.