Skip to departures
Machine Learning
Unlocking AI Efficiency: How Speculative Decoding Enhances Model Performance
Speculative decoding boosts AI model performance, delivering significant speed improvements and better handling of long-context tasks for practical ap...
GateMachine Learning
Departs
Modal Enhancements: Regional Routing, VM Sandboxes, Domain Allowlisting, and More
Modal introduces significant enhancements including regional routing for reduced latency, VM sandboxes for advanced workloads, and domain allowlisting...
GateMachine Learning
Departs
Optimizing FlashAttention-4 for Efficient Inference: Enhancements and Performance Metrics
Optimizations to FlashAttention-4 target improved inference efficiency, with a focus on lower precision inputs and enhanced memory access strategies.
GateMachine Learning
Departs
Ensuring Safety in Robotaxi Deployment with NVIDIA Halos System
NVIDIA's Halos system provides a comprehensive safety framework for robotaxis, addressing critical challenges in deployment and operation scalability.
GateMachine Learning
Departs
NVIDIA Introduces Scalable AI Models for Grasping, Autonomous Driving, and Virtual Agent Training
NVIDIA's latest research presents three advanced AI models aimed at facilitating robotic grasping, enhancing autonomous vehicle reasoning, and trainin...
GateMachine Learning
Departs
NVIDIA Unveils Comprehensive Physical AI Framework for Advanced Autonomous Vehicles and Robotics
NVIDIA's new physical AI tools streamline workflows for autonomous vehicles, robotics, and vision AI, advancing development with innovative skills and...
GateMachine Learning
Departs
Challenges of Reinforcement Learning Infrastructure and Optimal Solutions
This article examines the critical infrastructure challenges faced in reinforcement learning (RL) training and presents strategic solutions to optimiz...
GateMachine Learning
Departs
Enhancing Security with Role-Based Access Control for Agents and Developers
New Role-Based Access Control (RBAC) features on Modal provide a secure framework for managing agent and human access to resources within environments...
GateMachine Learning
Departs
Elevating AI Training: Applied Compute's Focus on Specific Intelligence through Reinforcement Learning
Applied Compute leverages reinforcement learning to develop tailored AI agents. This approach emphasizes adaptability, heavy reliance on proprietary d...
GateMachine Learning
Departs
Anthropic and Modal Unveil Next-Gen Managed Agents with Enhanced Sandboxes
The collaboration between Anthropic and Modal introduces Claude Managed Agents, offering developers scalable, cost-effective AI workflows with integra...
GateMachine Learning
Departs
Optimizing Serverless GPU Inference: Achieving Rapid Scaling and High Utilization
Modal’s approach to serverless GPUs enhances allocation utilization and minimizes start times, addressing the challenges of dynamic inference workload...
GateMachine Learning
Departs
Optimizing Multimodal Inference: Cache Lookup Enhancements in SGLang Yield Significant Performance Gains
SGLang v0.5.10 achieves over 16% throughput improvement and 10% latency reduction for multimodal inference through optimized cache lookups, enhancing...
GateMachine Learning
Departs
Developing a Reinforcement Learning Workflow for Automated Theorem Proving Using Modal
This article discusses the implementation of a reinforcement learning workflow for automated theorem proving using the Modal platform, focusing on eff...
GateMachine Learning
Departs
Leveraging Autoscaling in AI Research with Modal's Autoresearch Framework
Modal enhances AI research efficiency by integrating elastic GPU provisioning, enabling dynamic resource allocation for research workloads.
GateMachine Learning
Departs
Butter Team Joins Modal to Enhance Sandbox Technology
Butter's acquisition by Modal brings new expertise in code generation and agent engineering, aiming to improve Modal Sandboxes' functionality.
GateMachine Learning
Departs
Recent Product Enhancements: RTX Pro 6000 Blackwell and Modal Platform Improvements
NVIDIA's RTX Pro 6000 Blackwell is now integrated into Modal, alongside updates to the Command Palette and Sandbox Filesystem API, enhancing user expe...
GateMachine Learning
Departs
Runway Partners with Modal for Enhanced Real-Time Video Inference in Characters API
Runway integrates Modal's serverless computing to enhance real-time video capabilities for its Characters API, enabling diverse applications in variou...
GateMachine Learning
Departs
Doppel Enhances Machine Learning Workflows with Modal to Streamline Experimentation and Inference
Doppel improved its machine learning operations by migrating to Modal, achieving faster experimentation and more efficient inference with reduced infr...
GateMachine Learning
Departs
Modal's Infrastructure: Boosting AI Research Through Enhanced Workflows and Collaboration
Modal's innovative platform accelerates AI research by providing advanced infrastructure for managing complex workloads, enhancing collaboration among...
GateMachine Learning
Departs
Building a High-Performance Background Coding Agent with Modal at Ramp
Ramp’s integration of a background coding agent using Modal has revolutionized its development process, now powering over half of its merged pull requ...
GateMachine Learning
Departs