NVIDIA L40S - GPU computing processor - 900-2G133-0080-000

Overview:

NVIDIA L40S - GPU computing processor - NVIDIA L40S - 48 GB GDDR6 - PCIe 4.0 x16 - 4 x DisplayPort - fanless

Generative AI is fueling transformative change, unlocking a frontier of opportunities for enterprises across every industry. To transform with AI, enterprises need more compute resources, greater scale, and a broad set of capabilities to meet the demands of an ever-increasing set of diverse and complex workloads. The NVIDIA L40S GPU is a powerful universal GPU for the data center, delivering end-to-end acceleration for the next generation of AI-enabled applications - from generative AI and model training and inference to 3D graphics, rendering, and video applications.

• Generative AI
• Large language model (LLM) training and inference
• NVIDIA Omniverse Enterprise
• Rendering and 3D graphics
• Streaming and video content

• 4th gen Tensor Cores
  Hardware support for structural sparsity and optimized TF32 format provides out-of-the-box performance gains for faster AI and data science model training. Accelerate AI-enhanced graphics capabilities with DLSS to upscale resolution with better performance in select applications.
• Third-generation RT cores
  Enhanced throughput and concurrent ray-tracing and shading capabilities improve ray-tracing performance, accelerating renders for product design and architecture, engineering, and construction workflows. See lifelike designs in action with hardware-accelerated motion blur and stunning real-time animations.
• Transformer Engine
  Transformer Engine dramatically accelerates AI performance and improves memory utilization for both training and inference. Harnessing the power of the Ada Lovelace 4th gen Tensor Cores, Transformer Engine intelligently scans the layers of transformer architecture neural networks and automatically recasts between FP8 and FP16 precisions to deliver faster AI performance and accelerate training and inference.
• Data center ready
  The L40S GPU is optimized for 24/7 enterprise data center operations and designed, built, tested, and supported by NVIDIA to ensure maximum performance, durability, and uptime. The L40S GPU meets advanced data center standards, is Network Equipment-Building System (NEBS) Level 3 ready, and features secure boot with root of trust technology, providing an additional layer of security for data centers.