Neuromophic inspired chatbot (Alpha version)

This is my first attempt at an alternative biology inspired neuromorphic based chatbot. It uses three criterias (neuron shape i.e an inverse fft of the embedding, Pearson r of the embeddings and finally a graph factor , i.e how similar are the neurons to their immediate neighbours). in forming a different type of chatbot rather than the transformer – attention module. It’s still in alpha and seems to have mild success in a raw form of sentiment analysis but a lot of work is ahead.

It currently uses 10k samples from the tinystories dataset. Please let me know your feedback.

submitted by /u/ConfectionAfter2366 to r/learnmachinelearning
[link] [comments]


Commentaires

Laisser un commentaire

Votre adresse e-mail ne sera pas publiée. Les champs obligatoires sont indiqués avec *