[DAO:2dfb533] Developer Support Bot Trained On Decentraland Documents

by 0xce6bf74d6b9d998e5f44364899dabe3cb3ba8497

Should the following $5,000 grant in the Documentation category be approved?

Abstract

We propose to build a Discord bot for the Decentraland developer community that will use the latest technology around LLM’s (Large Language Models) to import Decentraland’s Github repos, documentation, Slack and Discord Q&A’s to provide an interface for Decentraland developers and users to ask questions in natural language.

Our goal is to provide another member to Decentraland’s DevRel team, reducing support hours on Discord and Slack and a path of triage for commonly asked questions (making the team and users get answers quicker).

Grant size

5,000 USD

Project duration

1 month

Beneficiary address

0xc5F1C802F56e34B05e9aAfBFE0302c6595405035

Email address

ali@trytali.com

Description

The core of technical Web3 projects depends on a healthy ecosystem of developers using the protocols. Developers learn how to use the various projects through inspecting developer docs and Github repositories. As expected, documentation doesn’t cover everything and a team of people are needed to provide “front line” support to those building/using the protocol.

Enter Developer Relations, a team tasked with being the first human interface with protocols who provide 2 critical roles for the project: building developer communities & tracking product-market fit.

The issue that often arises is a lack of human capital to be able to deal with the number of requests & questions that populate a DevRel team’s day.

We propose to provide a solution that will enable the Decentraland DevRel team to be able to focus on what they do best: solving unique customer problems and building trust in the protocol. By providing a bot that can answer previously asked questions, it will enable DevRel to become more effective and in turn provide higher quality support to end users.

Roadmap and milestones

We will use the funds to cover our development time (four weeks) and hosting for the bot for 6 months.

Project Plan:
Pre-Implementation: We’d like to work with the DevRel team to understand their needs, sticking points, and time sinks to see where the bot can be of most assistance. We’ll use these insights to see which data sources need to be implemented.

Milestone 1: Implementation of Data Sources [2 weeks]: Once discovery has been done, we’ll spend the time implementing the 3-4 most high-value data sources to Tali. We will leverage Llama Index to create indexes and a vector database to enable embeddings based search on queries. Optimization around how files are loaded, index creation, and integrating various data sources will need to be tested.

End state: Have 3-4 data sources that can be queried on. Expected bugs: hallucinations, mismatch on query/documents.

Milestone 2: Testing + Optimization [2 weeks]: Arguably the most important part of the process. The focus will be to discard hallucinations and optimize prompt engineering so only relevant answers appear, ideally with source material & links for the user to follow up on. The purpose of this will be to make the bot production ready.

End state: Production-ready bot ready (once signed off on by DevRel team) to be deployed to Decentraland Discord and or Slack.

Vote on this proposal on the Decentraland DAO

View this proposal on Snapshot

1 Like

Love this.

I think we need just a bit more information/discussion on Milestone 2, and attempting to reach an end-state which can allow the community to build on the said model.

I think I can get behind this if the hosting of the bot is passed over to the community + a framework/documentation for ingesting new data is provided (so that we can keep updating the model as needed/repeat the past processes done).

Keep in mind that DCL’s documentation is always changing and growing (at a very rapid rate), so we can’t have the bot stagnate. Additionally, being able to constantly have an up-to-date ingested reference (even if we’re just using it for a top_p - esque self reflection reference), will be extremely helpful in being able to plug in self-iterating agents to the bot.

IE: imagine an Auto-GPT that has the latest unity-renderer documentation, and is tasked with attempting to contribute new components to the DCL SDK (with a self-criticism model built around the proposed Support bot).

1 Like

Hi, thanks for your initiative. Very interesting topic ! :boom:

Please reach DAO Community in Discord and tell more about this proposal.

Hello, this is a great idea, but I see @HPrivakos building bots for the DCL DAO Discord which seems to be included in his salary. If this is needed, we should lean on those already doing it and pay them.

1 Like

Developer Support Bot Trained On Decentraland Documents

This proposal is now in status: REJECTED.

Voting Results:

  • Yes 2% 123,215 VP (47 votes)
  • No 78% 3,854,998 VP (88 votes)
  • Abstain 20% 1,033,634 VP (33 votes)