This is my first attempt at an alternative biology inspired neuromorphic based chatbot. It uses three criterias (neuron shape i.e an inverse fft of the embedding, Pearson r of the embeddings and finally a graph factor , i.e how similar are the neurons to their immediate neighbours). in forming a different type of chatbot rather than the transformer – attention module. It’s still in alpha and seems to have mild success in a raw form of sentiment analysis but a lot of work is ahead.
It currently uses 10k samples from the tinystories dataset. Please let me know your feedback.
submitted by /u/ConfectionAfter2366 to r/learnmachinelearning
[link] [comments]
Laisser un commentaire