73

Elon Musk's quest to wirelessly connect human brains with machines has run into a seemingly impossible obstacle, experts say. The company is now asking the public for help finding a solution.

Musk's startup Neuralink, which is in the early stages of testing in human subjects, is pitched as a brain implant that will let people control computers and other devices using their thoughts. Some of Musk's predictions for the technology include letting paralyzed people "walk again and use their arms normally."

Turning brain signals into computer inputs means transmitting a lot of data very quickly. A problem for Neuralink is that the implant generates about 200 times more brain data per second than it can currently wirelessly transmit. Now, the company is seeking a new algorithm that can transmit this data in a smaller package — a process called compression — through a public challenge.

As a barebones web page announcing the Neuralink Compression Challenge posted on Thursday explains, "[greater than] 200x compression is needed." The winning solution must also run in real time, and at low power.

top 50 comments
sorted by: hot top controversial new old
[-] dullbananas@lemmy.ca 88 points 1 month ago

Submit your algorithms under GPL

[-] potatopotato@sh.itjust.works 45 points 1 month ago

AGPL just in case they try to put your brain waves into the cloud

[-] orclev@lemmy.world 39 points 1 month ago

GPLv3, make it really radioactive to them.

[-] dariusj18@lemmy.world 55 points 1 month ago

Did they try Stack overflow?

[-] bus_factor@lemmy.world 35 points 1 month ago

Why not skip the middle man and ask ChatGPT directly?

[-] billiam0202@lemmy.world 13 points 1 month ago

*GrokAI

You know, Xitter's shittier AI.

[-] bus_factor@lemmy.world 4 points 1 month ago

Fair, I was thinking in the context of Stack Overflow.

[-] RobotZap10000@feddit.nl 23 points 1 month ago

Why would you ever want to do that?! Marked as duplicated. Shove a cactus up your ass.

[-] TheDudeV2@lemmy.ca 39 points 1 month ago* (last edited 1 month ago)

I’m not an Information Theory guy, but I am aware that, regardless of how clever one might hope to be, there is a theoretical limit on how compressed any given set of information could possibly be; and this is particularly true for the lossless compression demanded by this challenge.

Quote from the article:

The skepticism is well-founded, said Karl Martin, chief technology officer of data science company Integrate.ai. Martin's PhD thesis at the University of Toronto focused on data compression and security.

Neuralink's brainwave signals are compressible at ratios of around 2 to 1 and up to 7 to 1, he said in an email. But 200 to 1 "is far beyond what we expect to be the fundamental limit of possibility."

[-] orclev@lemmy.world 22 points 1 month ago

The implication of a 200 to 1 algorithm would be that the data they're collecting is almost entirely noise. Specifically that 99.5% of all the data is noise. In theory if they had sufficient processing in the implant they could filter the data down before transmission thus reducing the bandwidth usage by 99.5%. It seems like it would be fairly trivial to prove that any such 200 to 1 compression algorithm would be indistinguishable in function from a noise filter on the raw data.

It's not quite the same situation, but this should show some of the issues with this: https://matt.might.net/articles/why-infinite-or-guaranteed-file-compression-is-impossible/

[-] Death_Equity@lemmy.world 14 points 1 month ago

Absolutely, they need a better filter and on-board processing. It is like they are just gathering and transmitting for external processing instead of cherry picking the data matching an action that is previously trained and sending it as an output.

I'm guessing they kept the processing power low because of heat or power availability, they wanted to have that quiet "sleek" puck instead of a brick with a fanned heatsink. Maybe they should consider a jaunty hat to hide the hardware.

Gathering all the data available has future utility, but their data transmission bottleneck makes that capability to gather data worthless. They are trying to leap way too far ahead with too high of a vanity prioritization and getting bit for it, about par for the course with an Elon project.

[-] Stardust@kbin.social 9 points 1 month ago

There is a way they could make the majority of it noise - if they reduced their expectations to only picking up a single type of signal, like thinking of pressing a red button, and tossing anything that doesn't roughly match that signal. But then they wouldn't have their super fancy futuristic human-robot mind meld dream, or dream of introducing a dystopian nightmare where the government can read your thoughts...

[-] Paragone@lemmy.world 3 points 1 month ago

The problem isn't "making the majority of it noise",

the problem is tossing-out the actual-noise, & compressing only the signal.

Without knowing what the actual-signal is, & just trying to send all-the-noise-and-signal, they're creating their problem, requiring 200x compression, through wrongly-framing the question.

What they need to actually do, is to get a chip in before transmitting, which does the simplification/filtering.

That is the right problem.

That requires some immense understanding of the signal+noise that they're trying to work on, though, and it may require much more processing-power than they're committed to permitting on that side of the link.

shrug

Universe can't care about one's feelings: making-believing that reality is other than it actually-is may, with politial-stampeding, dent reality some, temporarily, but correction is implacable.

In this case, there's nothing they can do to escape the facts.

EITHER they eradicate enough of the noise before transmission,

XOR they transmit the noise, & hit an impossible compression problem.

Tough cookies.

_ /\ _

[-] QuadratureSurfer@lemmy.world 1 points 1 month ago* (last edited 1 month ago)

NAND - one of the 2 you listed, or they give up.

[-] Cocodapuf@lemmy.world 2 points 1 month ago

I'm not sure that's accurate.

Take video for example. Using different algorithms you can get a video down half the file size of the original. But with another algorithm you can get it down to 1/4 another can get it down to 1/10. If appropriate quality settings are used, the highly compressed video can look just as good as the original. The algorithm isn't getting rid of noise, it's finding better ways to express the data. Generally the fancier the algorithm, the more tricks it's using, the smaller you can get the data, but it's also usually harder to unpack.

[-] orclev@lemmy.world 5 points 1 month ago

It's important to distinguish between lossy and lossless algorithms. What was specifically requested in this case is a lossless algorithm which means that you must be able to perfectly reassemble the original input given only the compressed output. It must be an exact match, not a close match, but absolutely identical.

Lossless algorithms rely generally on two tricks. The first is removing common data. If for instance some format always includes some set of bytes in the same location you can remove them from the compressed data and rely on the decompression algorithm to know it needs to reinsert them. From a signal theory perspective those bytes represent noise as they don't convey meaningful data (they're not signal in other words).

The second trick is substituting shorter sequences for common longer ones. For instance if you can identify many long sequences of data that occur in multiple places you can create a lookup index and replace each of those long sequences with the shorter index key. The catch is that you obviously can't do this with every possible sequence of bytes unless the data is highly regular and you can use a standardized index that doesn't need to be included in the compressed data. Depending on how poorly you do in selecting the sequences to add to your index, or how unpredictable the data to be compressed is you can even end up taking up more space than the original once you account for the extra storage of the index.

From a theory perspective everything is classified as either signal or noise. Signal has meaning and is highly resistant to compression. Noise does not convey meaning and is typically easy to compress (because you can often just throw it away, either because you can recreate it from nothing as in the case of boilerplate byte sequences, or because it's redundant data that can be reconstructed from compressed signal).

Take for instance a worst case scenario for compression, a long sequence of random uniformly distributed bytes (perhaps as a one time pad). There's no boilerplate to remove, and no redundant data to remove, there is in effect no noise in the data only signal. Your only options for compression would be to construct a lookup index, but if the data is highly uniform it's likely there are no long sequences of repeated bytes. It's highly likely that you can create no index that would save any significant amount of space. This is in effect nearly impossible to compress.

Modern compression relies on the fact that most data formats are in fact highly predictable with lots of trimmable noise by way of redundant boilerplate, and common often repeated sequences, or in the case of lossy encodings even signal that can be discarded in favor of approximations that are largely indistinguishable from the original.

[-] Miaou@jlai.lu 1 points 1 month ago

Ugh? That's not what it means at all. Compression saves on redundant data, but it doesn't mean that data is noise. Or are you using some definition of noise I'm not aware of?

[-] TheDudeV2@lemmy.ca 4 points 1 month ago

I can try to explain, but there are people who know much more about this stuff than I do, so hopefully someone more knowledgeable steps in to check my work.

What does ‘random’ or ‘noise’ mean? In this context, random means that any given bit of information is equally as likely to be a 1 or a 0. Noise means a collection of information that is either random or unimportant/non-useful.

So, you say “Compression saves on redundant data”. Well, if we think that through, and consider the definitions I’ve given above, we will reason that ‘random noise’ either doesn’t have redundant information (due to the randomness), or that much of the information is not useful (due to its characteristic as noise).

I think that’s what the person is describing. Does that help?

[-] Miaou@jlai.lu 1 points 1 month ago

I agree with your point, but you're arguing that noise can be redundant data. I am arguing that redundant data is not necessarily noise.

In other words, a signal can never be filtered losslessly. You can slap a low pass filter in front of the signal and call it a day, but there's loss, and if lossless is a hard requirement then there's absolutely nothing you can do but work on compressing redundant data through e.g. patterns, interpolation, what have you (I don't know much about compression algos).

A perfectly noise free signal is arguably easier to compress actually as the signal is more predictable.

[-] Waldowal@lemmy.world 5 points 1 month ago

I'm no expert in this subject either, but a theoretical limit could be beyond 200x - depending on the data.

For example, a basic compression approach is to use a lookup table that allows you to map large values to smaller lookup ids. So, if the possible data only contains 2 values: One consisting of 10,000 letter 'a's. The other is 10,000 letter 'b's. We can map the first to number 1 and the second to number 2. With this lookup in place, a compressed value of "12211" would uncompress to 50,000 characters. A 10,000x compression ratio. Extrapolate that example out and there is no theoretical maximum to the compression ratio.

But that's when the data set is known and small. As the complexity grows, it does seem logical that a maximum limit would be introduced.

So, it might be possible to achieve 200x compression, but only if the complexity of the data set is below some threshold I'm not smart enough to calculate.

[-] QuadratureSurfer@lemmy.world 3 points 1 month ago* (last edited 1 month ago)

You also have to keep in mind that, the more you compress something, the more processing power you're going to need.

Whatever compression algorithm that is proposed will also need to be able to handle the data in real-time and at low-power.

But you are correct that compression beyond 200x is absolutely achievable.

A more visual example of compression could be something like one of the Stable Diffusion AI/ML models. The model may only be a few Gigabytes, but you could generate an insane amount of images that go well beyond that initial model size. And as long as someone else is using the same model/input/seed they can also generate the exact same image as someone else. So instead of having to transmit the entire 4k image itself, you just have to tell them the prompt, along with a few variables (the seed, the CFG Scale, the # of steps, etc) and they can generate the entire 4k image on their own machine that looks exactly the same as the one you generated on your machine.

So basically, for only ~~a few bits~~ about a kilobyte, you can get 20+MB worth of data transmitted in this way. The drawback is that you need a powerful computer and a lot of energy to regenerate those images, which brings us back to the problem of making this data conveyed in real-time while using low-power.

Edit:

Tap for some quick napkin mathFor transmitting the information to generate that image, you would need about 1KB to allow for 1k characters in the prompt (if you really even need that),
then about 2 bytes for the height,
2 for the width,
8 bytes for the seed,
less than a byte for the CFG and the Steps (but we'll just round up to 2 bytes).
Then, you would want something better than just a parity bit for ensuring the message is transmitted correctly, so let's throw on a 32 or 64 byte hash at the end...
That still only puts us a little over 1KB (1078Bytes)... So for generating a 4k image (.PNG file) we get ~24MB worth of lossless decompression.
That's 24,000,000 Bytes which gives us roughly a compression of about 20,000x
But of course, that's still going to take time to decompress as well as a decent spike in power consumption for about 30-60+ seconds (depending on hardware) which is far from anything "real-time".
Of course you could also be generating 8k images instead of 4k images... I'm not really stressing this idea to it's full potential by any means.

So in the end you get compression at a factor of more than 20,000x for using a method like this, but it won't be for low power or anywhere near "real-time".

[-] Cosmicomical@lemmy.world 3 points 1 month ago

just have to tell them the prompt, along with a few variables

Before you can do that, you have to spend hours of computation to figure out a prompt and a set of variables that perfectly match the picture you want to transmit.

load more comments (3 replies)
[-] Cocodapuf@lemmy.world 1 points 1 month ago

Neurons work in analogue data, I'm not sure lossless algorithms are necessary.

[-] SharkAttak@kbin.social 33 points 1 month ago

Why should we? What's in it for us?

[-] QuadratureSurfer@lemmy.world 26 points 1 month ago

A job interview! (I wish I was joking).

The reward for developing this miraculous leap forward in technology? A job interview, according to Neuralink employee Bliss Chapman. There is no mention of monetary compensation on the web page.

[-] Gsus4@mander.xyz 15 points 1 month ago* (last edited 1 month ago)

Nothing, but then you could patent it and license it to anyone but elon :) are you motivated yet?

[-] AngryCommieKender@lemmy.world 14 points 1 month ago

You can have a free "flamethrower" cigarette lighter. The company is bankrupt, and musk has a warehouse if the things he didn't sell.

load more comments (3 replies)
[-] drdiddlybadger@pawb.social 31 points 1 month ago

That isn't at all their problem their problem is scar tissue buildup that they haven't even bothered addressing. Wtf are they doing talking about data compression when they can't even maintain connection.

[-] Cocodapuf@lemmy.world 10 points 1 month ago

You really think they only have one problem to solve? If that were the case this would be relatively easy.

[-] BarbecueCowboy@lemmy.world 3 points 1 month ago* (last edited 1 month ago)

There were rumors of that and a lot of other complications in the animal trials. I don't think we ever got proof, but a lot of irregularities that were explained away. Could be a lot more problems coming.

[-] Modern_medicine_isnt@lemmy.world 1 points 1 month ago

Cause there are always more patients... but more data will let them get more press when it enables more interesting demos.

[-] Evotech@lemmy.world 22 points 1 month ago

Did they try middle out compression?

[-] AA5B@lemmy.world 22 points 1 month ago

Already solved by evolution. This is the same problem as all of us have with visual data. We’ve evolved to need much less data transfer by doing some image processing first. Same deal. Stick some processors in there so you only need to transfer processed results, not raw data

[-] Nomecks@lemmy.ca 19 points 1 month ago

Listen Elon, I have three words that will blow your mind: Middle out compression!

[-] AbidanYre@lemmy.world 22 points 1 month ago

That's a lot more civil than the three words I have for him.

[-] Luvs2Spuj@lemmy.world 15 points 1 month ago

He's such a genius, why would he look for additional help? All these claims are such shit. Remember when Tesla would be fully self driving and we would all whizzing around in tunnels? Fuck this guy.

load more comments (2 replies)
[-] Hugh_Jeggs@lemm.ee 12 points 1 month ago

I've got some of those bags you put your clothes in then seal with a vacuum cleaner, if that's any use

[-] palordrolap@kbin.social 11 points 1 month ago

Surprised they haven't tried to train a neural network to find a compression algorithm specifically for their sort of data.

There's a ridiculous irony in the fact they haven't, and it's still ironic even if they have and have thrown the idea out as a failure. Or a dystopian nightmare.

But if it is the latter, they might help save time and effort by telling "the public" what avenues have already failed, or that they don't want purely AI-generated solutions. Someone's bound to try it otherwise.

[-] orclev@lemmy.world 5 points 1 month ago

They did, but then Elon insisted they add a virtual neuralink into it and now the neural network is braindead.

[-] nifty@lemmy.world 9 points 1 month ago

This seems more like a hardware issue than a compression algorithm issue, but I could be wrong

[-] kibiz0r@midwest.social 6 points 1 month ago

How do you send 200x as much data?

You don’t. The external system needs to run an approximation of the internal system, which the internal system will also run and only transmit differences.

There you go. Solved it. (By delegating to a new problem.)

[-] MonkderDritte@feddit.de 3 points 1 month ago* (last edited 1 month ago)

They want to add compression to the implant?

And how does the brainwave data look? I'm sure they have some samples?

[-] partial_accumen@lemmy.world 7 points 1 month ago

They want to add compression to the implant?

They're making their own silicon for their sensor so adding an on-die ASIC for a specific compression method sounds pretty attainable.

[-] Cosmicomical@lemmy.world 3 points 1 month ago* (last edited 1 month ago)

What does this have to do with the question? Having samples of the data they want to compress is fundamental if you hope to find an algorythm to compress 200x.

[-] partial_accumen@lemmy.world 5 points 1 month ago

What does this have to do with the question? Having samples of the data they want to compress is fundamental if you hope to find an algorythm to compress 200x.

There were two questions asked. I answered for part of the first question. I have no information on the second question (samples). You're welcome to do your own googling to see if you can find an answer.

[-] SuperFola@programming.dev 3 points 1 month ago

Just add 199 more transmistters

load more comments
view more: next ›
this post was submitted on 28 May 2024
73 points (82.3% liked)

Technology

55610 readers
3532 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS