GPT-3 generating prime numbers when prompted with the first 12 primes (and very few mistakes). Amazing!

24

88

16

634

But there are probably lists of primes on the interwebz / in training data. I mean, it can also recite The Raven if I prompt with the first line, but I don't think that's because it's independently reproducing "While I pondered, weak and weary" :)

2

1

0

92

This tweet is unavailable

Memorizing indeed. I also tried Fibonacci numbers and it gets the first 37 numbers but meanders after that. So, the weights of GPT-3 haven't internalized the recursion or the primality test.

3

0

0

16

I only have access to AI dungeon's Dragon model, but I've had some success asking the AI to "spell out" it's thoughts step by step. Here are some simple chain rule applications.

12:12 AM · Jul 27, 2020

0

0

0

0