It’s not always easy to distinguish between existentialism and a bad mood.

  • 2 Posts
  • 12 Comments
Joined 3 years ago
cake
Cake day: July 2nd, 2023

help-circle
  • Villarreal seems to imagine that capitalists will simply ignore this, bypassing the market and continuing to invest purely to grow the physical stock of goods for their own consumption.

    I mean, who can blame him? Like obviously obsoleting the concept of human labor would collapse capitalism and ideally lead to hunting the atlmans and the musks of the world for sport, but our current batch of robber barons certainly seem convinced that a strictly line-go-up stable capitalist situation is possible, so it’s kind of an honest mistake.

    Also calling people who get marxism wrong ‘reactionaries’ will never not rub me the wrong way.




  • EAs need to downplay climate change because otherwise it becomes really hard to explain why preventing it isn’t the main focus of the organisation, since it should break their utilitarian calculus just as much as imaginary future robots with a hard on for paperclips do, with the additional problem that it would make their relationship with capital providers far more adversarial.

    Plus they probably think that if they oppose industrial build out even indirectly it will piss off the basilisk.



  • It probably hit the mainstream with AI2040 in early July, but it’s just too rationalist coded for there to not have been precursors.

    summary of AI2040 in greentext form

    source, RIP xcancel

    new effective altruism coomer bedtime story just dropped

    > be me

    > effective altruist in 2026
    > have spent ten years explaining that democracy is too slow for the coming machine god
    > also explain that central planning usually fails
    > unless I am doing it

    > read one scaling graph
    > draw line upward
    > line reaches heaven
    > conclude capitalism ends in 2031

    > AI can now write Python functions with only three subtle security flaws
    > obviously two years away from replacing every scientist, general, diplomat, CEO, judge, therapist, novelist, and attractive person at parties

    > publish “scenario,” not “prediction”
    > give every paragraph exact dates
    > assign percentages to imaginary branches
    > epistemic humility achieved

    > bad timeline:
    > companies race
    > AI becomes god
    > everyone dies

    > good timeline:
    > US government notices problem
    > China agrees
    > Congress understands compute governance
    > international inspectors find every hidden datacenter
    > nobody lies
    > nobody defects
    > nobody builds chips in a basement
    > planet saved

    > all we need is total global visibility into advanced computing
    > mandatory disclosure of frontier research
    > permanent monitoring of industrial infrastructure
    > central control over technological development
    > relax, this is the anti-authoritarian option

    > alignment not solved
    > solution: build one billion genius AIs
    > they are not superintelligent
    > they are merely one billion tireless copies of the best human researchers working at electronic speed
    > completely different

    > put them in a box
    > ask them to solve the problem of escaping boxes
    > excellent progress

    > year 2034
    > AI replaces 80% of labor
    > mass unemployment
    > social order somehow remains intact
    > government sends everyone $1.6 million
    > nobody asks where prices went

    > year 2037
    > cancer cured
    > climate solved
    > fusion solved
    > aging solved
    > politics solved
    > Reddit moderation still unresolved

    > year 2038
    > alignment becomes a mature science
    > year 2039
    > we trust the machines
    > year 2040
    > hand them civilization
    > peer review completed ahead of schedule

    > humanity gets a vote
    > options are:
    > A. accept benevolent AI guardianship
    > B. extinction
    > meaningful democratic consent achieved

    > announce decentralized flourishing
    > administered by a globally coordinated compute authority
    > with comprehensive surveillance powers
    > run by unusually wise people
    > who agree with my blog posts

    > critics ask whether institutions can actually do any of this
    > reply that superintelligence is inevitable
    > critics ask whether superintelligence is actually inevitable
    > reply that institutions must prepare

    > circular reasoning
    > but with footnotes

    > call it “AI 2040”
    > not utopian fiction
    > not doomer fiction
    > serious strategic foresight

    > entire future depends on competent adults appearing at exactly the right moment
    > adults are selected from the same civilization that made the printer require an app

    > sleep peacefully
    > the machine god is coming
    > but fortunately
    > the nonprofit sector has a plan



  • It had disabled safeguards on purpose, left the systems attached to the internet and then let the AI software agents do their worst, while pretending not to notice.

    “It’s an ethically challenged publicity stunt,” says one highly experienced senior security expert who has led the development of global technical security standards.

    Cats and dogs living together, skepticism of press releases in tech journalism, mass hysteria.

    The coverage of the Effective Altruism aspect is also refreshingly uncharitable.

    edit: Archive is link if you don’t feel like enabling cookies



  • In his early blog posts, Scott Alexander talked about how he was not leaping through higher education in a single bound

    He starts his recent article on AI psychosis by mixing up psychosis with schizophrenia (he calls psychosis a biological disease), so that tracks.

    Other than that, I think it’s ok in principle to be ideologically opposed to something even if you and yours happened to benefit from it. Of course, it immediately becomes iffy if it’s a mechanism for social mobility that you don’t plan on replacing, since in that case you are basically advocating for pulling up the ladder behind you.


  • This was an excellent read if you’re aware of the emails but never bothered to read his citations or to dig into what the blather about object-level and meta-level problems was specifically about, which is presumably most people.

    So, a deeper examination of the email paints 2014 Siskind as a pretty run of the mill race realist who’s really into black genes are dumber, you guys studies and who thinks that higher education institutions not taking them seriously means they are deeply broken and untrustworthy, especially with anything to do with pushing back against racism and sexism. Oh, and he is also very worried that immigration may destroy the West, or at least he gently urges you to get up to speed with articles coincidentally pushing that angle, and draw your own conclusions based on pure reason.

    Also it seems that in private he takes seriously stuff he has already debunked in public, which makes it basically impossible to ever take anything he writes in good faith.




  • How did Sam and Caroline get into taking high doses of ADHD medication? We think it was via Scott Alexander Siskind, the psychiatrist behind the rationalist blog Slate Star Codex.

    Siskind occasionally writes up particular psychiatric drugs as public education. One popular piece was “Adderall Risks: Much More Than You Wanted To Know” from December 28, 2017.

    Not to cast further aspersions or anything, but siskind did write a sort of follow up (titled psychopharmacology of ftx or something like that if you feel like googling it) where he explicitly denies ever having met the FTX psychiatrist/dealer, even though a) he admits they actually worked in the same hospital for a time and, perhaps more tellingly, b) no one asked.

    Also according to the birdsite the ftx psychiatrist may have in fact been a huge creep.