Close Menu
    Deepseek

    Free, open-source DeepSeek V3.2 Exp AI LLM debuts with lower compute costs, helping businesses save even more money

    AI Logic NewsBy No Comments3 Mins Read
    DeepSeek V3.2 Exp AI LLM uses a new sparce attention design to reduce compute costs while maintaining similar perfomance versus prior versions. (Image source: DeepSeek)
    DeepSeek V3.2 Exp AI LLM uses a new sparce attention design to reduce compute costs while maintaining similar perfomance versus prior versions. (Image source: DeepSeek)

    DeepSeek has released DeepSeek-V3.2-Exp, an experimental AI LLM designed to reduce compute costs while maintaining good performance when compared to its prior version, DeepSeek-V3.1-Terminus. The open-source model free to download and use, while the public API costs over 50% less.

    DeepSeek has released its latest artificial intelligence large-language model, DeepSeek-V3.2-Exp, with significantly reduced compute costs. This optimization helps businesses who use the company’s API in their apps save money while providing access to a smart AI, which has ranked 11th among the most powerful LLMs released worldwide.

    This was achieved by using a new DeepSeek Sparse Attention (DSA) design to focus on indexing tokens not with every other token, as is the case with traditional AI transformers, but only with the most relevant ones. This allows the AI to process input text faster up to its 128K-token window with less memory use.

    App developers accessing DeepSeek V3.2 Exp via its public API can expect to pay over 50% less than for the previous version, while maintaining comparable performance across standardized AI benchmarks.

    The 400 GB AI LLM can be downloaded from Hugging Face for free and run locally on powerful computers. Readers who do so will need a system with multiple Nvidia H100/H200/H20 GPUs or a single NVIDIA B200/GB200 server at minimum due to the model’s 1.5+ TB VRAM requirement.

    Readers who want to run DeepSeek v3.2 on home desktops will need to wait until quantized models are released on Hugging Face, such as this one for v3.1 by unsloth, and have a GPU with at least 24 GB of memory, such as this Nvidia 5090 on Amazon.

    DeepSeek V3.2 Exp ranked 11th among the world's most powerful AI models available upon release. (Image source: LMArena)
    DeepSeek V3.2 Exp ranked 11th among the world’s most powerful AI models available upon release. (Image source: LMArena)
    DeepSeek V3.2 Exp API costs to app developers have been reduced by more than 50% versus V3.1. (Image source: DeepSeek)
    DeepSeek V3.2 Exp API costs to app developers have been reduced by more than 50% versus V3.1. (Image source: DeepSeek)

    Source link

    Share.

    Related Posts