If you’re so smart why don’t you come up with a way to do it under 100 watts???
Also this is training them not using them. Using an ai consumes significantly less power than the process to train it sort of like how humans take more to learn than to put something in practice.
Yeap. They are trying to train the AI quickly, not over the course of 18 years.
Also, it’s early still early for these AI/LLM tools. The first few iterations of things are generally not very efficient. After you can prove it works, THEN you can make improvements to it, make it more efficient, etc.
However, I think that the approach of feeding in more power instead of optimizing it is the wrong approach. I feel Microsoft could get further ahead of it could find ways to train models more efficiently 🤷
I think his point is that the person he responded to is proposing well meaning feeling based policies without having any real knowledge of any of the negative impacts his policy would have.
The whole language model scene system started with “we accidently found something that kinda works” and is now in full “somebody please accidently find a way so it uses less power” mode.
I would take longer, but I bet I could do it. All ChatGPT does it’s basically regurgitate StackOverflow answers at you, and I’ve been doing that for years in my professional life
Mega corporations should not be allowed to use nuclear power plants purely for themselves.
Also, if you need that much power to do something bthat a human brain does with under 100 watts, I really think you’re doing it wrong
If you’re so smart why don’t you come up with a way to do it under 100 watts???
Also this is training them not using them. Using an ai consumes significantly less power than the process to train it sort of like how humans take more to learn than to put something in practice.
Yeap. They are trying to train the AI quickly, not over the course of 18 years.
Also, it’s early still early for these AI/LLM tools. The first few iterations of things are generally not very efficient. After you can prove it works, THEN you can make improvements to it, make it more efficient, etc.
However, I think that the approach of feeding in more power instead of optimizing it is the wrong approach. I feel Microsoft could get further ahead of it could find ways to train models more efficiently 🤷
People tend to forgot the millions of years of horribly inefficient evolution it took to develop the human brain.
Don’t think the point that’s being made is “smarturr” but rather that stay within the margins of available power.
I think his point is that the person he responded to is proposing well meaning feeling based policies without having any real knowledge of any of the negative impacts his policy would have.
I feel like I’m in that butterfly meme, going like is this what reasonable conversation is like.
<3
The whole language model scene system started with “we accidently found something that kinda works” and is now in full “somebody please accidently find a way so it uses less power” mode.
Why should they not be allowed? Nuclear power plants are great options and will mean less demand on worse energy providing sources
Almost all nuclear power plants in the US are privately owned and operated. Regardless of whether you agree with it or not, this isn’t new
Not a terrible argument. How do we limit compute vs. output?
deleted by creator
I would take longer, but I bet I could do it. All ChatGPT does it’s basically regurgitate StackOverflow answers at you, and I’ve been doing that for years in my professional life
deleted by creator