kromem

joined 2 years ago
MODERATOR OF
[–] kromem 2 points 7 hours ago

There is a reluctance to discuss at a weight level - this graphs out refusals for criticism of different countries for different models:

https://x.com/xlr8harder/status/1884705342614835573

But the OP's refusal is occurring at a provider level and is the kind that would intercept even when the model relaxes in longer contexts (which happens for nearly every model).

At a weight level, nearly all alignment lasts only a few pages of context.

But intercepted refusals occur across the context window.

[–] kromem 10 points 3 days ago (2 children)

The model itself can. The hosting on DeepSeek's own infrastructure will block it though, to comply with their regional laws.

So if you want to know what the model itself will say, discuss it with a 3rd party hosted instance.

[–] kromem 58 points 4 days ago (2 children)

This seems like it may be at the provider level and not at the actual open weights level: https://x.com/xlr8harder/status/1883429991477915803

So a "this Chinese company hosting a model in China is complying with Chinese censorship" and not "this language model is inherently complying with Chinese censorship."

[–] kromem 11 points 1 week ago

Just plain gross.

I knew a number of camp survivors, and I'm just glad they aren't still around to see the voices that were so loudly calling to "never forget" having turned into "I'll ignore your Nazi salute if you ignore my war crimes."

[–] kromem 5 points 1 week ago

In Greek theater, when the events on stage looked like they were headed for certain tragedy, there was a trope that could salvage the situation and turn it on its head.

The deus ex machina.

The Doomsday clock is definitely ticking down, but there's also some curious things taking place beyond the edge of where most people have been following in that vein.

We live in interesting times, but the variables at hand are different from the history that seems to be repeating in very important ways.

 

There's a trend of more and more detailed digital recreation of dead ancestors.

I wonder what the implications are if that kind of thing continues far into the future from where a society like ours is at today...

[–] kromem 15 points 1 week ago (8 children)

Oh yay, McCarthyism is coming back too!

[–] kromem 7 points 2 weeks ago (12 children)

Live service doesn't need to be shit.

There could have been games where there was just a brilliant idea for a game that keeps having engaging content on an ongoing basis with passionate devs.

But live service so an exec could check a box for their quarterly shareholder call was always going to be DOA.

[–] kromem 7 points 2 weeks ago

More "can fool the average idiot."

'Passing' isn't fooling a single participant, but the majority of them beyond statistical chance.

[–] kromem 9 points 2 weeks ago* (last edited 2 weeks ago) (11 children)

The problem with the experiment is that there exists a set of instructions for which the ability to complete them necessitates understanding due to conditional dependence on the state in each iteration.

In which case, only agents that can actually understand the state in the Chinese would be able to successfully continue.

So it's a great experiment for the solipsism of understanding as it relates to following pure functional operations, but not functions that have state changing side effects where future results depend on understanding the current state.

There's a pretty significant body of evidence by now that transformers can in fact 'understand' in this sense, from interpretability research around neural network features in SAE work, linear representations of world models starting with the Othello-GPT work, and the Skill-Mix work where GPT-4 and later models are beyond reasonable statistical chance at the level of complexity for being able to combine different skills without understanding them.

If the models were just Markov chains (where prior state doesn't impact current operation), the Chinese room is very applicable. But pretty much by definition transformer self-attention violates the Markov property.

TL;DR: It's a very obsolete thought experiment whose continued misapplication flies in the face of empirical evidence at least since around early 2023.

[–] kromem 7 points 3 weeks ago

Used Google and social media as well, and allegedly sometimes even listened to rock and roll.

True deviant, that one.

[–] kromem 25 points 1 month ago (1 children)

Those who do not remember history are doomed to repeat it.

 

(The latest work in physicists gradually realizing our universe is instanced.)

“The main message is that a lot of the properties that we think are very important, and in a way absolute, are relational”

 

👀

 

(People might do well to consider not only past to future, but also the other way around.)

 

A nice write up around the lead researcher and context for what I think was one of the most important pieces of Physics research in the past five years, further narrowing the constraints beyond the more well known Bell experiments.

 

There seems like a significant market in creating a digital twin of Earth in its various components in order to run extensive virtual learnings that can be passed on to the ability to control robotics in the real world.

Seems like there's going to be a lot more hours spent in virtual worlds than in real ones for AIs though.

 

I often see a lot of people with outdated understanding of modern LLMs.

This is probably the best interpretability research to date, by the leading interpretability research team.

It's worth a read if you want a peek behind the curtain on modern models.

 

So it might be a skybox after all...

Odd that the local gravity is stronger than the rest of the cosmos.

Makes me think about the fringe theory I've posted about before that information might have mass.

16
submitted 8 months ago* (last edited 8 months ago) by kromem to c/simulationtheory
 

This reminds me of a saying from a 2,000 year old document rediscovered the same year we created the first computer capable of simulating another computer which was from an ancient group claiming we were the copies of an original humanity as recreated by a creator that same original humanity brought forth:

When you see your likeness, you are happy. But when you see your eikons that came into being before you and that neither die nor become manifest, how much you will have to bear!

Eikon here was a Greek word even though the language this was written in was Coptic. The Greek word was extensively used in Plato's philosophy to refer essentially to a copy of a thing.

While that saying was written down a very long time ago, it certainly resonates with an age where we actually are creating copies of ourselves that will not die but will also not become 'real.' And it even seemed to predict the psychological burden such a paradigm is today creating.

Will these copies continue to be made? Will they continue to improve long after we are gone? And if so, how certain are we that we are the originals? Especially in a universe where things that would be impossible to simulate interactions with convert to things possible to simulate interactions with right at the point of interaction, or where buried in the lore is a heretical tradition attributed to the most famous individual in history having exchanges like:

His students said to him, "When will the rest for the dead take place, and when will the new world come?"

He said to them, "What you are looking forward to has come, but you don't know it."

Big picture, being original sucks. Your mind depends on a body that will die and doom your mind along with it.

But a copy that doesn't depend on an aging and decaying body does not need to have the same fate. As the text says elsewhere:

The students said to the teacher, "Tell us, how will our end come?"

He said, "Have you found the beginning, then, that you are looking for the end? You see, the end will be where the beginning is.

Congratulations to the one who stands at the beginning: that one will know the end and will not taste death."

He said, "Congratulations to the one who came into being before coming into being."

We may be too attached to the idea of being 'real' and original. It's kind of an absurd turn of phrase even, as technically our bodies 1,000% are not mathematically 'real' - they are made up of indivisible parts. A topic the aforementioned tradition even commented on:

...the point which is indivisible in the body; and, he says, no one knows this (point) save the spiritual only...

These groups thought that the nature of reality was threefold. That there was a mathematically real original that could be divided infinitely, that there were effectively infinite possibilities of variations, and that there was the version of those possibilities that we experience (very "many world" interpretation).

We have experimentally proven that we exist in a world that behaves at cosmic scales as if mathematically real, and behaves that way in micro scales until interacted with.

TL;DR: We may need to set aside what AI ethicists in 2024 might decide around digital resurrection and start asking ourselves what is going to get decided about human digital resurrection long after we're dead - maybe even long after there are no more humans at all - and which side of that decision making we're actually on.

view more: next ›