Protect your right to run local AI

Join the discussion

• Hacker News
• Pardon me, so they'll hunt down huggingface, ollama and china? I don't quite understand? What about the millenia of companies that provide apis for local llms and private companies that use local llms for privacy reasons? I don't even understand how you'd execute such a ruleset.
  by onesandofgrain
• Dario and friends are fear mongering local models to get them banned.
  by wesleywt
• I mean if you go into old AI safety discussion from before LLMs you'll see they don't do that. They go after new hardware. That's way easier than going after software. Hardware doesn't last forever and manufacturers will gladly cripple their cards and license powerful ones to businesses.
  by pixl97
• Given the state of corruption in politics, I think Anthropic and OpenAI will likely bribe … oh wait I mean “lobby” … for bans on open source. Otherwise their imaginary trillion dollar valuations make no sense.
  by SilverElfin
• their desperation says alot about the viability of their business.
  by byzantinegene
• They already are. Altman is basically begging the US to buy into OAI, that's just the start. Both OAI and Anthropic are going to have to go down this path or their financials will never work out. Open local models are where the enterprise will need to go for any of this to be cost feasible, but we can almost guarantee this will be a battle nobody using AI will have asked for. You can thank Dario and Sam for the dystopian future that will pad their bottom line!
  by windexh8er
• This whole situation is very reminiscent of how Microsoft was trying to get Linux and open source banned when NT started losing market share on the server.
  by yogthos
• This. They can see their valuations slipping. They hope that in a few/several years they will start reaping profits. However, in several years local hardware will be well suited to run models locally at 80-90% efficiency - for "free". You won't need frontier models for daily tasks in a few years. I'd guess.
  by stanislavb
• This is exactly where I'd like to see things going. Depending entirely on cloud-hosted intelligence feels more fragile and invasive every year.
  by mune2gu-chan
• The biggest threat to the hyper-scalers is small bespoked models run locally. You don't need the world's stolen information to run a small project containing locally trained data you collected. But you do need to block everyone if you want to capture the entire market and get the trillion dollar valuation.
  by wesleywt
• > You don't need the world's stolen information to run a small project containing locally trained data you collected.

  Local training? Is that feasible?

  by worik
• In the US at least, repealing a law takes the same number of votes as passing a new one. I don't follow the purpose of this, unless it's to pass a constitutional amendment or something. Or maybe just to get clicks on a website.

  And I already have the right to local intelligence, because my GPUs are my private property, and if someone freely releases a beerware model then I can freely download it.

  What am I missing?

  by tjwebbnorfolk
• How long do you think your hardware will last?
  by pixl97
• you can also freely download CP on your private property PC

  but I wouldn't advise it

  by nok22kon
• I think the bogeyman would be making possession of a local AI a felony.
  by julianlam
• They say:

  > Fraud, cybercrime, CSAM, harassment, nonconsensual intimate deepfakes, discrimination, and sabotage should stay illegal and be enforced seriously.

  The "enforced seriously" part is how they will get you. Don't worry, there won't be a blanket ban on local models. Instead, any model that is "certified CSAM-free" or whatever will be perfectly legal. Meaning that it's impossible to prompt it into producing underage smut in any shape or form.

  Of course, any model running locally can be easily jailbroken via prefills, and so in practice it will be a blanket ban. But good luck politically standing up against something that is explicitly worded as an anti-CSAM / anti-terrorist measure and nominally constrained to those areas.

  by int_19h
• This is one of those things we should absolutely push proactively rather than reactively, if only because I’ve had several “chats” with AI models both local and AIaaS, and all repeat the same talking point that AIaaS is the only sensible, safe, and secure choice.

  Which is bullshit, unless you’re an AIaaS company whose revenue is dependent on state-sanctioned market fixing and regulatory capture.

  Look, when this shitty cycle ends, we’re likely to find ourselves back in the start of a new memory cycle of surplus and lower costs. We’re talking what very well may be the boom that shatters the 16GB “baseline” we’ve been stuck at for over a decade in consumer computing, and make larger RAM counts (64GB to 1TB+) valuable to consumers specifically for local AI workloads. Local AI isn’t just an enthusiast thing, it’s likely the future of consumer AI provided we don’t let companies and policymakers curtail its use via fearmongering.

  Be proactive, and protect consumer right to compute and AI models. Enforce existing laws, don’t outlaw legitimate use just to prop up an unsustainable business model.

  by stego-tech
• Amen. Local AI is the positive future, and SaaS AI is the hellscape. There is a very clear good vs evil boundary here, and every single person involved knows exactly where the boundary is. Those who pretend not to are simply just motivated by things other than the moral good.
  by slopinthebag
• I don't know why people are so sure that Mythos level+ models will be made freely available.

  Obviously money is not freely distributed, so how could we possibly make the case that power will be?

  All that needs to happen is Xi Jinpeng feel that Chinese SOTA models would be better kept to benefit solely China, and just upon that single utterance, no more models will come out of China.

  by WarmWash
• I think Anthropic has been really successful in their branding of Mythos as something, mythical.

  I never heard anyone contemplating "why people are so sure we'd get freely available GPT-4 level+ models".

  Mythos is just another advancement in AI model capability. If we start pretending like it isn't, we are setting ourselves up for paying far more than is reasonable and accepting the frame that we should not in fact have free access to open models with the same capabilities.

  This is just marketing.

  I can't wait for some similar big steps in open weight models.

  by mosselman
• the music may stop in the future, but right now it isn't even slowing down.

  Xi did not interfere when Chinese labs released GPT-4, o1, o3, etc level models. why draw the line at current SOTA that will be old news in a year?

  by vlian2088
• Chinese culture is opensource. Every single city in China which are often focused around one particular thing. For example clothing or electronics, are sharing tech, experience, methodologies etc between each other. It's how the Chinese system works. It's very unnatural to hide and project inventions. In the US it's the absolute way around. That's why in China you don't have patent trolls and piles of lawyers sueing the shit out of everyone
  by holoduke
• That would not make much strategic sense. China's main advantage is its export power. Why would they cut that off? They are also making incredible investments in actual power to sustain this. The kind of investments the United States doesn't seem capable of making, mostly because our leaders are staggeringly incompetent and unfit. And no, picking the bar up off the floor is not good enough.

  Once they dominate the market, they will export to keep it that way. The exported models will be a generation or two behind their SOTA. It will nevertheless surpass Mythos unless you believe we are already at the peak. And it might be "free" but it will obviously be backdoored the same way the United States government benefits from Microsoft's global dominance. The same way America hands out fighter jets just generation behind their own best to keep other governments part of the club and in line.

  Unlike the United States where every four years we are at risk to some 180 on policy the Chinese have a clear thesis and a clear direction. How many presidents has Xi seen come and go? Do you get the sense he is getting more impressed? They really don't have to do anything but just keep doing what they are doing. Suddenly stopping their export engine is not in keeping with this strategy. That is "stable genius" behavior.

  by godwinson__4-8
• Is anyone seeing this?

  ```

  Warning Suspected Phishing This website has been reported for potential phishing.

  Phishing is when a site attempts to steal sensitive information by falsely presenting as a safe source.

  Cloudflare Ray ID: <retracted_because_what_is_this> • Your IP: • Performance & security by Cloudflare

  ```

  Who "reports" this? And why does cloudfare take them down? How does this even work?

  by stephen_cagle
• Also seen on my end (US-east).
  by ProllyInfamous
• Same warning.
  by dr41d45
• yep. seeing it here as well.

  i’d be curious to know more details as well. is this a targeted mass reporting or something?

  by toofy
• I didn't even get that far:

  ```

  This site can’t provide a secure connection righttointelligence.org sent an invalid response.

  Try running Windows Network Diagnostics. ERR_SSL_PROTOCOL_ERROR

  ```

  by Computer0
• I'm more worried about getting cut off from hardware because Nvidia can make more money selling to datacenters than I am about getting cut off from software.
  by apitman
• Inference isn't that hard, you can run on amd/ Intel if needed.
  by dummydummy1234