Skip to departures
AI Industry & Funding
Modal Auto Endpoints: Empowering Teams to Own Inference Infrastructure
Modal's Auto Endpoints give teams the ability to manage and optimize their own inference setups, emphasizing cost-effective solutions without sacrific...
GateMachine Learning
Departs
Optimizing Sandbox Startup Times: Understanding Latency Beyond Container Booting
Achieving faster sandbox user experiences requires addressing the entire startup lifecycle, from initial container booting to application readiness.
GateMachine Learning
Departs
Unlocking AI Efficiency: How Speculative Decoding Enhances Model Performance
Speculative decoding boosts AI model performance, delivering significant speed improvements and better handling of long-context tasks for practical ap...
GateMachine Learning
Departs
Modal Enhancements: Regional Routing, VM Sandboxes, Domain Allowlisting, and More
Modal introduces significant enhancements including regional routing for reduced latency, VM sandboxes for advanced workloads, and domain allowlisting...
GateMachine Learning
Departs
Optimizing FlashAttention-4 for Efficient Inference: Enhancements and Performance Metrics
Optimizations to FlashAttention-4 target improved inference efficiency, with a focus on lower precision inputs and enhanced memory access strategies.
GateMachine Learning
Departs
Ensuring Safety in Robotaxi Deployment with NVIDIA Halos System
NVIDIA's Halos system provides a comprehensive safety framework for robotaxis, addressing critical challenges in deployment and operation scalability.
GateMachine Learning
Departs
NVIDIA Introduces Scalable AI Models for Grasping, Autonomous Driving, and Virtual Agent Training
NVIDIA's latest research presents three advanced AI models aimed at facilitating robotic grasping, enhancing autonomous vehicle reasoning, and trainin...
GateMachine Learning
Departs
NVIDIA Unveils Comprehensive Physical AI Framework for Advanced Autonomous Vehicles and Robotics
NVIDIA's new physical AI tools streamline workflows for autonomous vehicles, robotics, and vision AI, advancing development with innovative skills and...
GateMachine Learning
Departs
Challenges of Reinforcement Learning Infrastructure and Optimal Solutions
This article examines the critical infrastructure challenges faced in reinforcement learning (RL) training and presents strategic solutions to optimiz...
GateMachine Learning
Departs
Enhancing Security with Role-Based Access Control for Agents and Developers
New Role-Based Access Control (RBAC) features on Modal provide a secure framework for managing agent and human access to resources within environments...
GateMachine Learning
Departs
Elevating AI Training: Applied Compute's Focus on Specific Intelligence through Reinforcement Learning
Applied Compute leverages reinforcement learning to develop tailored AI agents. This approach emphasizes adaptability, heavy reliance on proprietary d...
GateMachine Learning
Departs
Anthropic and Modal Unveil Next-Gen Managed Agents with Enhanced Sandboxes
The collaboration between Anthropic and Modal introduces Claude Managed Agents, offering developers scalable, cost-effective AI workflows with integra...
GateMachine Learning
Departs
Optimizing Serverless GPU Inference: Achieving Rapid Scaling and High Utilization
Modal’s approach to serverless GPUs enhances allocation utilization and minimizes start times, addressing the challenges of dynamic inference workload...
GateMachine Learning
Departs
Optimizing Multimodal Inference: Cache Lookup Enhancements in SGLang Yield Significant Performance Gains
SGLang v0.5.10 achieves over 16% throughput improvement and 10% latency reduction for multimodal inference through optimized cache lookups, enhancing...
GateMachine Learning
Departs
Developing a Reinforcement Learning Workflow for Automated Theorem Proving Using Modal
This article discusses the implementation of a reinforcement learning workflow for automated theorem proving using the Modal platform, focusing on eff...
GateMachine Learning
Departs
Creating Custom Agents with OpenAI's Agents SDK and Modal Integration
OpenAI's new Agents SDK enables developers to build tailored coding agents and internal tools efficiently, leveraging Modal's powerful sandbox environ...
GateGenerative AI
Departs
Leveraging Autoscaling in AI Research with Modal's Autoresearch Framework
Modal enhances AI research efficiency by integrating elastic GPU provisioning, enabling dynamic resource allocation for research workloads.
GateMachine Learning
Departs
Butter Team Joins Modal to Enhance Sandbox Technology
Butter's acquisition by Modal brings new expertise in code generation and agent engineering, aiming to improve Modal Sandboxes' functionality.
GateMachine Learning
Departs
Recent Product Enhancements: RTX Pro 6000 Blackwell and Modal Platform Improvements
NVIDIA's RTX Pro 6000 Blackwell is now integrated into Modal, alongside updates to the Command Palette and Sandbox Filesystem API, enhancing user expe...
GateMachine Learning
Departs
Runway Partners with Modal for Enhanced Real-Time Video Inference in Characters API
Runway integrates Modal's serverless computing to enhance real-time video capabilities for its Characters API, enabling diverse applications in variou...
GateMachine Learning
Departs