I think that’s fair, although we had a bunch of folks here suggesting that the models which are able to accomplish these tasks and pass these tests somehow don’t actually contain knowledge of things.
They created a text generation software that 1/3 of their customer base would not want people knowing they are using it.
Seems pretty cool.
Lol, lots of companies make products that their customers don’t want to advertise they are using.
To be clear, I actually don’t like open AI, as they contribute much less to the rest of the research community than the other bigs, but some of these criticisms are silly.
Is it correct commentary?
It looks like it literally copied someone’s comment from whatever code repository it stole that code from.
Yeah, just a plagiarism machine plagiarizing, nothing to see here.
The probability distribution giveth, the probability distribution taketh away.
Note: the function definition was written by me, I was just writing some random docs after I wrote the function def so i could pick it up and work on it later. Copilot has the habit of trying to insert ghost text that’s mostly either 1) Cutting pasting the last line of code I wrote, but substituting in the most recent variable name I’m using or 2) pasting in entire functions I’ve already written.
Copilot for the R language is pretty close to absolute garbage.
The only thing copilot did was add the commentary on my hackiness.
This is funny though.
I don’t know if I mentioned it, but at one point one of our agents using a language model managed to rickroll one of our engineers.
Wait so copilot roasted your code? That’s actually hilarious.
Yeah, I was kinda surprised. Granted, I’ve definitely written that sort of comment into my code before, but that’s MY job.
Someone at work had a similar experience - They wrote a comment above a function “there is” and copilot filled in “a bug in this code!”. There was no bug.
Makes me glad I would often add some commentary to my exceptions handling, like “Shut 'er down Clancy, she’s pumping mud!” or “If you are seeing this exception the fundamental laws of physics have been violated”, “You must be truly desperate to come to this catch statement for help”.
My favorite is “Future me is gonna be so, so mad.”
My favourite illustration of this effect:
from:
Precisely. And they’re also a pretty shit way of measuring the knowledge of the student. Speaking from personal experience, as both a student and as an examinator.
In my University courses, it was pretty hard to get the “Extraordinary” score on one’s semester test, because basically you need to not only demonstrate perfect knowledge, but also demonstrate knowledge beyond what was expected for your level. I got it twice. The first time was fair enough - it was Ph.d. level material
The second time was a paper on methodology which I and a mate wrote in the weekend before the monday submission deadline. The examiner was soo impressed.
Everything that I’ve seen from LLMs so far reminds me of the second case: i.e., material which was - literally, in our case - regurgitated from a text book which we had barely touched all semester.
The idea that educational degrees measure knowledge or intelligence never made sense to me since. It just shows that you have (presumably) read some books, done some courses, and sat some tests - nothing else.
This video is pretty wild. Actual flying drones going up and down trees picking apples off the tree.
I gotta wonder though - is that actually less expensive, or is it just a cool prototype? Those drones look like they are picking fruit at 5% of the speed of a human, and no doubt cost a lot more to buy/rent and pay electricity for.
To me, it kinda looks like a prototype. Look how they are dropping the apples in the flat surface that barely have a small vertical wooden barrier so they don’t roll and fall
A real collecting device would have a much deeper storage, instead of what it seems it can store barely 150 apples.
But in two more years, I’m sure they will have improved and be more ready for Production-time.
2 years sounds like just enough time to perfect the deportation AI.