This document discusses desirable features for deep learning frameworks. It outlines several key aspects ("MAPS"): scalability, portability, augmented computation patterns, and modularity. For scalability, frameworks should support distributed training across multiple GPUs and machines. For portability, frameworks need to run on various platforms like mobile, IoT, and embedded devices. They should also support quantized and sparse math to improve efficiency. Finally, frameworks benefit from a modular design that reuses components from optimized math libraries and communication primitives. The goal is flexible yet efficient frameworks that can satisfy the needs of both research and industry applications.