• 0 Posts
  • 23 Comments
Joined 2 years ago
cake
Cake day: June 11th, 2023

help-circle

  • Yeah, countries should realize that brain drain is much more serious issue than is usually portrayed.

    But honestly the issues that lead to brain drain are far beyond what one or a few people in power can fix. It’s usually caused by deep societal issues, things that emerge after little dysfunctions snowball all the way to the large system that is the whole country.

    For example, I’ve seen articles like this which in my opinion summarize what is the real issue in Brazilian society. But also one could argue this behavior becomes prevalent because society is already dysfunctional and people normalize the current way of thinking. It’s really a chicken and egg problem to solve when you look at the whole country scale.





  • It is unpredictable because there are so many permutations

    Actually LLMs are unpredictable not only because the space of possible outputs (combinatorics) is huge, though that also doesn’t help us understand them.

    Like there might be an astronomical number of different proteins but biophysics might be able to make somewhat accurate predictions based on the properties we know (even if it requires careful testing in the real thing).

    For example, it might be tempting to calculate the tokens associations somehow and kinda create a function mapping what happens when you add this or that value in the input to at least estimate what the result would be.

    But what happens with LLMs is changing one token in a prompt produces a sometimes disproportionate or unintuitive change in the result, because it can be amplified or dampened depending on the organization of the internal layers.

    And even if the model’s internal probability distribution were perfectly understood, its sampling step (top-k, nucleus sampling, temperature scaling) adds another layer of unpredictability.

    So while the process is deterministic in principle, it’s not calculable in a tractable sense—like weather prediction.





  • It’s very possible for someone to appear fine in public while struggling privately. The family can’t be blamed for not realizing what was happening.

    The bigger issue is that LLMs were released without sufficient safeguards. They were rushed to market to attract investment before their risks were understood.

    It’s worth remembering that Google and Facebook already had systems comparable to ChatGPT, but they kept them as research tools because the outputs were unpredictable and the societal impact was unknown.

    Only after OpenAI pushed theirs into the public sphere (framing it as a step toward AGI) Google and Facebook did follow, not out of readiness, but out of fear of being left behind.








  • Folks, we have the most INCREDIBLE announcement today. Maybe the best in the history of announcements, many people are saying it. We’re launching the beautiful Maxest app — and by the way, it was my idea, nobody else could have thought of this. It will come pre-installed on every phone. The fake news media will try to tell you it’s some kind of “spy app” - WRONG! Totally wrong!

    The Democrats don’t want you to have this amazing technology. They want you to stay uninformed! But we’re giving you the most beautiful, most secure app ever created. Our cyber experts — the best in the world, probably the best who have ever lived — they built walls around this app.

    Other countries will be so jealous of our app, they’ll probably try to steal it. But they can’t, because it’s AMERICAN MADE!