{"id":16159,"date":"2025-04-23T02:28:50","date_gmt":"2025-04-23T02:28:50","guid":{"rendered":"https:\/\/fusionmindlabs.com\/blogs\/chinese-ai-startup-blocks-sensitive-images\/"},"modified":"2025-04-23T02:28:50","modified_gmt":"2025-04-23T02:28:50","slug":"chinese-ai-startup-blocks-sensitive-images","status":"publish","type":"post","link":"https:\/\/fusionmindlabs.com\/blogs\/chinese-ai-startup-blocks-sensitive-images\/","title":{"rendered":"Chinese AI startup blocks sensitive images"},"content":{"rendered":"\n<\/p>\n
\n

A startup based in China, Sand AI<\/a>, has introduced an open-source video-generating AI model that has garnered significant praise from prominent entrepreneurs, including Kai-Fu Lee, the founding director of Microsoft Research Asia. However, it appears that Sand AI is censoring certain images that could potentially raise concerns with Chinese regulators on the hosted version of the model, according to testing conducted by TechCrunch.<\/p>\n

Earlier in the week, Sand AI announced the launch of Magi-1<\/a>, a model that generates videos by predicting sequences of frames in an autoregressive manner. The company claims that Magi-1 can produce high-quality, controllable footage that accurately captures physics more effectively than rival open models.<\/p>\n

\n

\ud83d\udc40 You won\u2019t believe this is AI-generated
\ud83e\udde0 You won\u2019t believe it\u2019s open-source
\ud83c\udfac You won\u2019t believe it\u2019s FREE<\/p>\n

Magi-1 video model has outperformed commercial video tools<\/p>\n

For more details and examples, click here: \ud83d\udc47 pic.twitter.com\/zlXRecWeqH<\/a><\/p>\n

\u2014 Farhan (@mhdfaran) April 21, 2025<\/a><\/p>\n<\/blockquote>\n

Due to its massive size of 24 billion parameters, Magi-1 is impractical to run on most consumer hardware, requiring between four and eight Nvidia H100 GPUs. As a result, Sand AI’s platform is the primary means for many users, including this reporter, to test drive Magi-1.<\/p>\n

To initiate video generation, the platform requires a “prompt” image. However, not all prompts are allowed, as TechCrunch discovered. Sand AI blocks image uploads of Xi Jinping, Tiananmen Square, Tank Man, the Taiwanese flag, and insignias supporting Hong Kong liberation. The filtering occurs at the image level, and renaming image files does not bypass the blocking.<\/p>\n

\"Sand
Sand AI\u2019s online platform displays an error message when it detects a likely prohibited image<\/span>Image Credits:<\/strong>Sand AI<\/span><\/figcaption><\/figure>\n

Sand AI is not the only Chinese startup that prevents uploads of politically sensitive images to its video generation tool. Hailuo AI, a Shanghai-based generative media platform, also blocks photos of Xi Jinping. However, Sand AI’s filtering appears to be more aggressive, as Hailuo allows images of Tiananmen Square.<\/p>\n

As explained by Wired in a January article, models in China are required to adhere to stringent information controls. A 2023 law prohibits models from generating content that “damages the unity of the country and social harmony,” meaning it counters the government’s historical and political narratives. To comply, Chinese startups often censor their models through prompt-level filters or fine-tuning.<\/p>\n

Interestingly, while Chinese models tend to block political speech, they often have fewer filters than their American counterparts for pornographic content. A recent report by 404 revealed that several video generators released by Chinese companies lack basic guardrails that prevent people from generating nonconsensual nudity.<\/p>\n<\/div>\n