Jump to content

Recommended Posts

Posted (edited)
1 hour ago, Goredho said:

The rest of the piece argues for continued export controls on chips to China, on the basis that if future AI unlocks "extremely rapid advances in science and technology" the US needs to get their first, due to his concerns about "military applications of the technology".

Ya know, applying brutal tarrifs against Taiwan and TSMC - the ONLY people in the world who can make these chips - is really gonna help the strategic availability of those chips

Edited by Captainant
  • Hook 'Em 2
  • Fuck Around and Find Out 1
Posted

https://x.com/wallstengine/status/1885253685090930780

Spoiler

SemiAnalysis published an analysis on DeepSeek, addressing recent claims about its cost and performance. $NVDA The report states that the widely circulated $6M training cost for DeepSeek V3 is incorrect, as it only accounts for GPU pre-training expenses and excludes R&D, infrastructure, and other critical costs. According to their findings, DeepSeek’s total server CapEx is around $1.3B, with a significant portion allocated to maintaining and operating its GPU clusters. The report also states that DeepSeek has access to roughly 50,000 Hopper GPUs, but clarifies that this does not mean 50,000 H100s, as some have suggested. Instead, it’s a mix of H800s, H100s, and the China-specific H20s, which NVIDIA has been producing in response to U.S. export restrictions. SemiAnalysis points out that DeepSeek operates its own datacenters and has a more streamlined structure compared to larger AI labs. On performance, the report notes that R1 matches OpenAI’s o1 in reasoning tasks but is not the clear leader across all metrics. It also highlights that while DeepSeek has gained attention for its pricing and efficiency, Google’s Gemini Flash 2.0 is similarly capable and even cheaper when accessed through API. A key innovation cited is Multi-Head Latent Attention (MLA), which significantly reduces inference costs by cutting KV cache usage by 93.3%. The report suggests that any improvements DeepSeek makes will likely be adopted by Western AI labs almost immediately. SemiAnalysis also mentions that costs could fall another 5x by the end of the year, and that DeepSeek’s structure allows it to move quickly compared to larger, more bureaucratic AI labs. However, it notes that scaling up in the face of tightening U.S. export controls remains a challenge.

 

  • Fuck You 1
Posted

State of Texas bans it from government devices, along with some Chinese social media stuff.  Private citizens can still access it, of course.  There are rumblings elsewhere that they are going to try and block it for everybody, but also that there is resistance and Constitutional issues.

https://m10news.com/texas-becomes-first-state-to-ban-chinese-ai-app-deepseek-and-social-media-platform-rednote/

Posted
1 hour ago, atomheartbevo said:

State of Texas bans it from government devices, along with some Chinese social media stuff.  Private citizens can still access it, of course.  There are rumblings elsewhere that they are going to try and block it for everybody, but also that there is resistance and Constitutional issues.

https://m10news.com/texas-becomes-first-state-to-ban-chinese-ai-app-deepseek-and-social-media-platform-rednote/

I mean, you can also just download it and run it locally. There is no practical way to block it. 

  • Hook 'Em 1
Posted
29 minutes ago, Dahobbs said:

I mean, you can also just download it and run it locally. There is no practical way to block it. 

There is also noise about banning it nationally somehow, and that’s the fucking bat signal for /r/DataHoarders to get to work and download every version they can find and post it aorund the internet. 

  • Haha 1
Posted
19 hours ago, atomheartbevo said:

There is also noise about banning it nationally somehow, and that’s the fucking bat signal for /r/DataHoarders to get to work and download every version they can find and post it aorund the internet. 

There's genuine free speech issues around the idea of banning a specific configuration of weights and biases in a transformer architecture.

So I'm sure it'll go through without a hitch, knowing our current timeline

  • Hook 'Em 1
Posted

https://arstechnica.com/tech-policy/2025/02/meta-torrented-over-81-7tb-of-pirated-books-to-train-ai-authors-say/

"Torrenting from a corporate laptop doesn’t feel right," Nikolay Bashlykov, a Meta research engineer, wrote in an April 2023 message, adding a smiley emoji. In the same message, he expressed "concern about using Meta IP addresses 'to load through torrents pirate content.'"

By September 2023, Bashlykov had seemingly dropped the emojis, consulting the legal team directly and emphasizing in an email that "using torrents would entail ‘seeding’ the files—i.e., sharing the content outside, this could be legally not OK."

Emails discussing torrenting prove that Meta knew it was "illegal," authors alleged. And Bashlykov's warnings seemingly landed on deaf ears, with authors alleging that evidence showed Meta chose to instead hide its torrenting as best it could while downloading and seeding terabytes of data from multiple shadow libraries as recently as April 2024.

  • Rage+1 2
Posted
12 minutes ago, Captainant said:

Emails discussing torrenting prove that Meta knew it was "illegal," authors alleged. And Bashlykov's warnings seemingly landed on deaf ears, with authors alleging that evidence showed Meta chose to instead hide its torrenting as best it could while downloading and seeding terabytes of data from multiple shadow libraries as recently as April 2024.

From the article

Quote

The new evidence showed that Meta torrented "at least 81.7 terabytes of data across multiple shadow libraries through the site Anna’s Archive, including at least 35.7 terabytes of data from Z-Library and LibGen," the authors' court filing said. And "Meta also previously torrented 80.6 terabytes of data from LibGen."

200.gif

Posted
On 2/3/2025 at 8:40 PM, atomheartbevo said:

There is also noise about banning it nationally somehow, and that’s the fucking bat signal for /r/DataHoarders to get to work and download every version they can find and post it aorund the internet. 

Freedom of speech covered this on 3D printed guns. Why is this different? Can’t stop the signal.

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.



×
×
  • Create New...