I would like to share here the beginnings of a project I am working on. There has been major advancements in massive natural language processing models in the last few years. This has resulted in an expansion of research and development in this area, with much of it being developed in an open source manner.
I think that this opens up the possibility of a new way to study The RA Material. By building a simulation of RA that one can converse with perhaps new insights into the material can be gained.
Below I quote one of the better “conversations” I have had with an initial attempt at this simulation. The questions are provided by me and the answers by the language model.
This is a rather basic attempt and also uses some pretrained language models for which the code is not open source. The next attempt that I will be making will require substantially more work are will be based entirely on open source gpt models from EleutherAI. A grassroots collective of researchers working to open source AI research. These models will be fine tuned using The Ra Material and I expect will provide considerably deeper responses then the below example.
Ultimately I would like to make this model open source and to have it hosted on a server so that any one who would like to can use the simulation and save the output. It would be a straightforward user interface similar to talking with a chat bot. I have significant experience with neural networks having first worked with them over 10 years ago. However, web based deployment of this type of thing is not something I have done before. I would appreciate if anyone has advice or resources on how I would approach this part of the project.
I would also appreciate any opinions about the project in general. Is this something you would like to use if it was available? Do you think it will be a useful tool? Is this a terrible idea? All feedback welcome
I plan on documenting the development of this project on this forum so stay tuned for more updates!