avatar
Yoav Goldberg @yoavgo.bsky.social

i agree that the language is being used. but the language is pretty much the only part that is being meaningfully used.

jul 4, 2025, 6:35 am • 0 0

Replies

avatar
וושינגטון אירבינג @wlrving.bsky.social

The language allows for greater efficiency which carried the ML to the DL era. In the same sense that you need calculus for physics. You could write everything down as additions and multiplications. You just will have a very very bad time...

jul 4, 2025, 6:41 am • 1 0 • view
avatar
Yoav Goldberg @yoavgo.bsky.social

what efficiency are we discussing here? efficiency of communication, or efficiency of computation?

jul 4, 2025, 6:48 am • 0 0 • view
avatar
וושינגטון אירבינג @wlrving.bsky.social

Yes

jul 4, 2025, 7:28 am • 0 0 • view
avatar
Yoav Goldberg @yoavgo.bsky.social

so i would argue that efficiency of computation is nice but also somewhat accidental and not that important. but lets focus on efficiency of communication: my point is kinda exactly around this. in a field that is actually built around algebra, the communication efficiency would be MUCH higher.

jul 4, 2025, 7:37 am • 0 0 • view
avatar
Yoav Goldberg @yoavgo.bsky.social

because when we use a term such as "a norm" we get the definition, which is nice, but also a bunch of properties that hold for items of this kind. and if we dont actually rely on these properties later on, then its a waste in terms of what we communicated.

jul 4, 2025, 7:40 am • 0 0 • view
avatar
וושינגטון אירבינג @wlrving.bsky.social

Oh I thought you were talking about communication within the electronics which are built specifically to perform the (for instance) norm optimally

jul 4, 2025, 8:57 am • 1 0 • view
avatar
Yoav Goldberg @yoavgo.bsky.social

btw, re the hardware example: the hatdware is not built to perform "norm". it is built to approximate norm over a floating point representation of real numbers. this is highly specific and doesnt enjoy the generality of algebra at all. i think it may not even be commutative and associative.

jul 4, 2025, 9:25 am • 0 0 • view
avatar
וושינגטון אירבינג @wlrving.bsky.social

Yes yes. And everything can be broken down to mov and add. And yet if you try to describe and design things using those commands you'll not get very far.

jul 4, 2025, 12:58 pm • 1 0 • view