Editing Rietenpetardat
Jump to navigation
Jump to search
The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.
Latest revision | Your text | ||
Line 6: | Line 6: | ||
| prefix = Mention | | prefix = Mention | ||
| owner = [[User:Edward|Edward]] | | owner = [[User:Edward|Edward]] | ||
| language = | | language = C++, JavaScript | ||
| sourcecode = https://github.com/Edward205/markov-discord-bot (old version) | | sourcecode = https://github.com/Edward205/markov-discord-bot (old version) | ||
| invitelink = Not available to public | | invitelink = Not available to public | ||
}} | }} | ||
'''rietenpetardat''' (also known as Ortobebop) is a [[wikipedia:Chatbot|chatbot]] created by [[Edward]] for the [[OkPrietenRetardat|OKPR]] Discord server. Its purpose is to talk to server users in a similar way to a regular member of the community. Over time, it has received updates such as new commands and changes to the core architecture. It is intended for the OKPR community, as such it is not allowed to be added to other servers. | '''rietenpetardat''' (also known as Ortobebop) is a [[wikipedia:Chatbot|chatbot]] created by [[User:Edward|Edward]] for the [[OkPrietenRetardat|OKPR]] Discord server. Its purpose is to talk to server users in a similar way to a regular member of the community. Over time, it has received updates such as new commands and changes to the core architecture. It is intended for the OKPR community, as such it is not allowed to be added to other servers. | ||
== Development == | |||
== Development | |||
=== Initial version === | === Initial version === | ||
Line 41: | Line 20: | ||
As per the GPL3 license under which the original IRC chatbot code is subject, the modified source code for rietenpetardat can be found here: https://github.com/Edward205/markov-discord-bot | As per the GPL3 license under which the original IRC chatbot code is subject, the modified source code for rietenpetardat can be found here: https://github.com/Edward205/markov-discord-bot | ||
The first tests of this version were done starting with 29th of August 2022 and it | The first tests of this version were done starting with 29th of August 2022 and it as released on the OKPR Discord server the next day. | ||
=== Addition of the copypasta command === | === Addition of the copypasta command === | ||
Line 62: | Line 41: | ||
=== Temporary shutdown === | === Temporary shutdown === | ||
As of April 24, 2023 the GPT-3 chat functions and the ChatGPT command no longer work because Edward's payment method started rejecting payments from OpenAI, making the API inaccessible. | |||
=== Future plans === | |||
Edward is planning on training a custom model as described below. An attempt has been made to train a language model using [https://marian-nmt.github.io/ marian-nmt], but this has not been successful. He is now planning to train a GPT-style model. | |||
== Technical details and research == | == Technical details and research == | ||
Chatbots are complex programs, requiring a high degree of analysis and processing of text data. One approach that would eliminate our dependence on an external service and generate coherent conversations would be to train an LLM with just the OKPR chat data. This could be trained from scratch or by fine-tuning. | Chatbots are complex programs, requiring a high degree of analysis and processing of text data. One approach that would eliminate our dependence on an external service and generate coherent conversations would be to train an LLM with just the OKPR chat data. This could be trained from scratch or by fine-tuning. | ||
All generation-related code | All generation-related code, with the exception of GPT-3 and ChatGPT, was written in C++ so as to be as fast as possible and linked to [https://discord.js.org/ discord.js] via the stdin and stdout interface. | ||
The training data for the algorithms or LLMs is an archive of text messages from the #bucuresti-general channel on OKPR v2, taken one day before it was deleted (see [[OkPrietenRetardat/Timeline|Timeline]]). Additionally, another archive of the #bucuresti-general channel from OKPR v3 was taken which will also be used. These archives are not publicly available. | The training data for the algorithms or LLMs is an archive of text messages from the #bucuresti-general channel on OKPR v2, taken one day before it was deleted (see [[OkPrietenRetardat/Timeline|Timeline]]). Additionally, another archive of the #bucuresti-general channel from OKPR v3 was taken which will also be used. These archives are not publicly available. |