TAG
#multimodal
Stories connected through a shared idea, actor, technology or theme.
Meta releases 816-billion-parameter open-weight Muse Spark OpenThe natively multimodal mixture-of-experts model has 816 billion total parameters, 42 billion active parameters and a one-million-token context window. Meta positions it for coding, long-horizon agentic work and multimodal reasoning, with weights available through major model hubs and inference providers.→Mistral opens public preview of trillion-parameter Large 4 modelMistral Large 4 is a natively multimodal mixture-of-experts model with about 1.05 trillion total parameters and 52 billion active parameters. The preview supports a one-million-token context window, while model weights are planned for later release.→Google makes Nano Banana 2.1 generally availableNano Banana 2.1 improves visual quality, prompt adherence, multi-turn character consistency and text rendering. It also adds wide and panoramic aspect ratios across 1K, 2K and 4K output sizes, while the previous image endpoint is deprecated.→AI study suggests heart-transplant rejection may be flagged without biopsyThe study trained an AI system on electrocardiogram data paired with biopsy-linked biomarkers from transplant recipients. The researchers present it as a potential way to identify rejection earlier while reducing reliance on invasive biopsies.→Google releases Gemini 3.8 Flash TTS and Flash-Lite TTSGemini 3.8 Flash TTS targets expressive, controllable voice creation, while Flash-Lite TTS is optimised for high-volume generation and voice agents. Google says both models include consent verification, SynthID watermarking and C2PA credentials for replicated voices.→StepFun releases Step 5 Preview with 600B parameters and million-token contextStep 5 Preview has 600 billion total parameters and 27 billion active parameters, according to the launch report. StepFun opened API access immediately and said model weights would follow on October 15.→Alibaba releases open-weight Qwen Image 2.1Qwen Image 2.1 is available through Hugging Face and ModelScope for visual generation and editing tasks. The model supports transparent-image generation and can use up to ten reference images, under a research and evaluation licence.→Google releases Gemini 3.8 Live with background reasoning for voice agentsGoogle announced Gemini 3.8 Live and Gemini 3.8 Live Extended Thinking on 15 September. The models support visual context, switching across 97 languages and asynchronous tools; Google reports leading results on speech-agent benchmarks.→OpenAI releases ChatGPT Images 2.5 with sharper editing and faster generationChatGPT Images 2.5 improves reference fidelity, multi-turn editing and layout accuracy, while OpenAI reports latency reductions of up to 50% compared with Images 2.0. The release also adds Sketch, templates and image comments, alongside API models named GPT-Image-2.5 Flare and Sunburst.→Google makes Gemini video analysis goal-directed and more efficientGoogle launched agentic video understanding across Gemini 3.7 Flash, 3.6 Flash and 3.5 Flash-Lite in the Gemini API, AI Studio and Gemini Enterprise Agent Platform. Google reports up to 88% lower token consumption, 66% lower analysis cost and 7% higher accuracy on its standard benchmarks, with Gemini app and Ask YouTube rollouts planned.→Google releases Gemini Omni 1.1 Flash for controllable AI videoGoogle released Gemini Omni 1.1 Flash as a production-ready multimodal video model and API update with scene extension, first-and-last-frame interpolation, 360p drafts and upscaling to 4K. Google says scene extensions can use up to 10 seconds of prior context and accumulate to 40 seconds through Gemini API, AI Studio, Enterprise Agent Platform and Flow.→Vercel AI SDK adds a Z.AI provider with GLM-5.3 Flash supportThe @ai-sdk/zai 2.0.0 release adds a Z.AI provider with GLM chat completions, streaming, reasoning, tool use and multimodal inputs. It also backports GLM-5.3-Flash model support to the Z.AI provider and AI Gateway.→Token fingerprints link anonymous Ox Alpha to Baseten's GLM-5.2 VisionTests on four B200 GPUs found matching image-tokenisation fingerprints and token counts, while a reconstructed hidden system prompt produced a 75-token delta and explicitly named ox-alpha. The identification is an analysis rather than a confirmed disclosure from Baseten, so the model's provenance remains uncertain.→Ox Alpha reports an 80% pass rate on the full 113-task DeepSWE runThe report says Ox Alpha completed all 113 tasks and was available through OpenRouter, Venice and Nous Research. The result is a researcher-reported evaluation rather than an independent audit, and the model's underlying identity remains disputed.→DeepSeek adds vision to V4 Flash in an experimental API modelDeepSeek's official API documentation says the experimental model matches V4 Flash on text capabilities, including agents, reasoning and world knowledge, while adding mixed text-and-image input. The company reports multimodal agent performance close to Anthropic's Opus 4.8 and makes the model available through Chat Completions, Messages and Responses.→Deepfake evaluation shifts towards localisation and interpretationThe second Deepfake Detection, Localization and Interpretability Challenge uses a multimodal deepfake description dataset enriched with Qwen3-VL. It evaluates more than image-level classification by targeting localisation and interpretable traces of manipulation.→