ADAS: search and evaluation for agent design
Published on August 26, 2024, the paper describes an iterative method for proposing agents from domain information and evaluating the proposals.
Source: ADAS usa busca para projetar e avaliar sistemas agênticos (x.com). Text prepared with AI from this source.
What happened and what to do
The paper on ADAS, published on August 26, 2024, describes Automated Design of Agentic Systems. Its method uses search to propose agents based on a domain description, framework code, instructions, and output examples; new agents are evaluated and added to an archive of discovered agents. The paper states that the framework was tested, without specifying the test results here.
A company can apply this approach to a bounded process: define inputs and evaluation criteria, test agents on representative cases, and keep a record of versions and results. Implementation could include an API to run evaluations, failure monitoring, and a dashboard to track performance and changes between versions.
How the consultancy can help
Wendelmaques can diagnose the process and its risks, define evaluation criteria, and propose an implementation with an API, monitoring, and a dashboard. The scope can also include operating the testing workflow and agent archive.
Next step
Send a short description of the process or agents you want to evaluate to receive a scoped proposal.
Let's assess your project
I reply with scope and a proposal.