Recent Enhancements in Modal: Cloud Bucket Mounting, Okta SSO, and More

Modal has rolled out significant updates designed to streamline development workflows and enhance service integration. Here's an overview of the key features introduced this month.

🪣 Cloud Bucket Mounts

One of the noteworthy features in this update is the capability to mount cloud storage buckets directly into containers. This feature supports integrations with major cloud platforms like AWS S3 and Cloudflare R2, allowing users to interact with these services as if they were local storage. This crucial functionality fosters better data accessibility and handling, which is essential for modern application development.

In practical terms, this means developers can manipulate files stored on these cloud services directly within their containers, without needing to transfer data back and forth. This could significantly reduce latency in file operations and streamline workflows that depend on cloud storage. The documentation provides detailed guidance on how to utilize this feature effectively, illustrating its potential benefits.

🌪️ @web_server Decorator

With the increased demand for hosting diverse web applications, Modal has introduced an easier way to serve content through web servers that don't utilize ASGI or WSGI protocols. The new @web_server decorator allows developers to specify a listening port for HTTP requests directly within the container's environment. This simplifies the process for developers, allowing them to deploy applications without needing intricate configurations or deep integration into typical architectures like ASGI or WSGI.

This change also broadens the types of applications that can be hosted on Modal, making the platform attractive to a wider swath of developers. For additional details, refer to the documentation.

🔑 Okta Single Sign-On Integration

For enterprise plan users, Okta is now available as an authentication option. Incorporating Okta enhances security, particularly for organizations that manage sensitive information. It streamlines access control processes, allowing IT departments to centralize user management and authentication activities. This integration is becoming increasingly important as cyber threats grow more sophisticated, and companies beef up their security protocols.

For those looking to implement this feature, Modal’s support team is readily available to assist with the integration, ensuring a smooth transition and minimal disruption. Comprehensive details can be found in the documentation, which outlines step-by-step implementation procedures.

📀 Volume Viewer

Modal has improved the user experience regarding file system management with the introduction of the volume viewer. Users can now explore their volume file systems through the web dashboard, enhancing their ability to monitor and manage data stacks. This is more significant than it looks; an intuitive interface enhances workflow efficiency by allowing users to see file organization and access permissions at a glance. It can prevent common errors that occur when file handling is cumbersome.

This feature provides not only convenience but also empowers users to optimize their storage solutions. For an overview of how to navigate this new tool, visit the Storage tab.

👩‍💻 Client Updates

Developers using Modal can upgrade to the latest client features with the command pip install --upgrade modal. This update includes several enhancements aimed at improving the user experience: from support for composing applications across multiple files to enhanced iteration capabilities for dictionaries. These changes foster a more flexible development environment, catering to the varying needs of modern applications.

• Support for composing applications across multiple files using .include.
• Enhanced iteration capabilities for dictionaries, including methods for accessing keys, values, and items.
• Function execution now allows input cancellation without terminating the entire container, a feature that can save time during debugging and adjustments.
• Memory limits for functions are now supported, providing developers with better resource management, crucial for optimizing application performance.
• The Image.run_function method has been updated to accept arguments and keyword arguments, allowing for greater flexibility and control.
• Queues can now include multiple partitions, streamlining task management and enhancing overall efficiency.
• Sandbox environments now support writing to stdin, enabling more interactive applications, which is a feature that many developers have sought.
• modal.dict allows command-line manipulation of dictionary objects, providing more flexibility in scripting.
• The modal run -i command restores support for remote breakpoints in debugging, something many developers will appreciate during the testing phase.
• The modal volume get and put commands now accommodate larger files, expanding the range of use cases for file operations.

A comprehensive list of all updates is available in the changelog.

🥑 Fresh Blog Posts

In addition to product updates, Modal has published several new articles that may be of interest to the development community. These articles cover various topics, from high-performance computing techniques to effective strategies for integrating with existing stacks.

• Get 4,500 tok/s on Lama 3 using TRT-LLM
• Beating Proprietary Embedding Models with a Quick Fine-Tune
• Why you should move your ETL stack to Modal
• Render a video with Blender on many GPUs in parallel
• Run Gemma with vLLM

Implications for Users and Developers

If you're working in this space, these updates from Modal are more than just a series of enhancements; they signal a shift towards more user-centric development tools. A more streamlined workflow, especially in terms of integrating storage and enabling broader service compatibility, could lead to significant productivity boosts. Organizations can potentially reduce costs associated with development and maintenance by lowering the barrier for deploying complex applications.

Engagement within the Modal community encourages collaborative discussions among developers. It’s a great opportunity to share what you’ve built and get feedback. If you’ve developed something using Modal, feel free to share it on our Slack channel. Your insights are invaluable as we continue to evolve our offerings. There's a symbiotic relationship between user feedback and product improvements, shaping what comes next.

For those who may have missed previous updates, a collection of earlier announcements can be accessed here for February, November, August, July, and May.