Cheers for this. I tried a few of them while I’m waiting around and had one excellent result. I’m a near expert in one topic and I often test AIs against my knowledge for fun.
Perplexity.AI did the best I’ve seen; it sourced its arguments which, finally, weren’t wrong so if I needed to, I could actually learn more about what it was talking about. It’s not 100% but the other AI are so bad at this topic I test it on I always give up immediately.
I wouldn’t have seen it if it wasn’t for this post so thank you very much.
I don’t know if anyone will read this but I did further testing on perplexity when I got home. It’s probably not the right spot for it.
I tried a more trickier question and then I chose the available prompts to move forward (it suggests questions related to the original question if you are unsure how to prompt it next). The prompts were intelligent and were probably the next question I would assume I would ask if I were learning about this topic. On the next answer, it literally quoted something I wrote, almost word for word, on the exact subject which, according to me (of course) would be the correct answer.
I’ve never had an AI even reference a single thing I’ve written. I had prompted it into a general area where the things I had wrote existed so it should be expected but it made the connection almost instantly and answered the question 100% accurately.
As much as I hate it, well done Skynet.
Edit: After further testing, I can catch it out regularly enough but still, if I had to tell someone about the topic generally via email, I’d probably recommend it rather than me waste time typing it all out. I’ve just put myself out of a job.
I’m curious what your area of expertise is? I’m interested in using ai for a programming assistant, but it seems an entirely different skillset than, say, a language model. I assume some models will be good in 1 area and some models in another
Mine is in plants which a lot of models seem to struggle with. It’s not the science side, it’s the application side so with that, there is another layer of intelligence that the AI has to break through to appeal to me (answer my particular questions).
I tested it again with something even more particular and unique to an Australian plant and it was way off. I think I may have been one of the only people to ever post a particular technique to reddit and the AI mustn’t be searching in there as it didn’t even know about it even when asked directly. To its credit, it did give a good suggestion on who to contact to find out more.
very hit and miss. It’s okay if Im trying to learn something new, and once or twice it has found and suggested some fix that I probably wouldn’t have thought of otherwise - but it also makes up methods & syntax and then you’re playing ‘whack a mole’ to figure out where it hallucinated.
I think right now it’s not really boosting my productivity much, but I think in another 5ish years it could be better.
Cheers for this. I tried a few of them while I’m waiting around and had one excellent result. I’m a near expert in one topic and I often test AIs against my knowledge for fun.
Perplexity.AI did the best I’ve seen; it sourced its arguments which, finally, weren’t wrong so if I needed to, I could actually learn more about what it was talking about. It’s not 100% but the other AI are so bad at this topic I test it on I always give up immediately.
I wouldn’t have seen it if it wasn’t for this post so thank you very much.
I don’t know if anyone will read this but I did further testing on perplexity when I got home. It’s probably not the right spot for it.
I tried a more trickier question and then I chose the available prompts to move forward (it suggests questions related to the original question if you are unsure how to prompt it next). The prompts were intelligent and were probably the next question I would assume I would ask if I were learning about this topic. On the next answer, it literally quoted something I wrote, almost word for word, on the exact subject which, according to me (of course) would be the correct answer.
I’ve never had an AI even reference a single thing I’ve written. I had prompted it into a general area where the things I had wrote existed so it should be expected but it made the connection almost instantly and answered the question 100% accurately.
As much as I hate it, well done Skynet.
Edit: After further testing, I can catch it out regularly enough but still, if I had to tell someone about the topic generally via email, I’d probably recommend it rather than me waste time typing it all out. I’ve just put myself out of a job.
I’m curious what your area of expertise is? I’m interested in using ai for a programming assistant, but it seems an entirely different skillset than, say, a language model. I assume some models will be good in 1 area and some models in another
Mine is in plants which a lot of models seem to struggle with. It’s not the science side, it’s the application side so with that, there is another layer of intelligence that the AI has to break through to appeal to me (answer my particular questions).
I tested it again with something even more particular and unique to an Australian plant and it was way off. I think I may have been one of the only people to ever post a particular technique to reddit and the AI mustn’t be searching in there as it didn’t even know about it even when asked directly. To its credit, it did give a good suggestion on who to contact to find out more.
How has your experience been using it as a programming assistant? I’m trying to do this too
very hit and miss. It’s okay if Im trying to learn something new, and once or twice it has found and suggested some fix that I probably wouldn’t have thought of otherwise - but it also makes up methods & syntax and then you’re playing ‘whack a mole’ to figure out where it hallucinated.
I think right now it’s not really boosting my productivity much, but I think in another 5ish years it could be better.