Skip to content

Commit

Permalink
Update Readme News & Update AFLOW's entrance.
Browse files Browse the repository at this point in the history
  • Loading branch information
didiforgithub committed Oct 29, 2024
1 parent dbfd37b commit bbb087b
Show file tree
Hide file tree
Showing 10 changed files with 78 additions and 362 deletions.
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,8 @@
</p>

## News
🚀 Oct. 29, 2024: We introduce three papers: [AFLOW: Automating Agentic Workflow Generation](https://arxiv.org/abs/2410.10762), [FACT: Examining the Effectiveness of Iterative Context Rewriting for Multi-fact Retrieval](https://arxiv.org/abs/2410.21012), and [SELA: Tree-Search Enhanced LLM Agents for Automated Machine Learning](https://arxiv.org/abs/2410.17238), along with code implementations available in the `examples` directory. Welcome your usage and feedback!

🚀 Mar. 29, 2024: [v0.8.0](https://github.com/geekan/MetaGPT/releases/tag/v0.8.0) released. Now you can use Data Interpreter ([arxiv](https://arxiv.org/abs/2402.18679), [example](https://docs.deepwisdom.ai/main/en/DataInterpreter/), [code](https://github.com/geekan/MetaGPT/tree/main/examples/di)) via pypi package import. Meanwhile, we integrated the RAG module and supported multiple new LLMs.

🚀 Feb. 08, 2024: [v0.7.0](https://github.com/geekan/MetaGPT/releases/tag/v0.7.0) released, supporting assigning different LLMs to different Roles. We also introduced [Data Interpreter](https://github.com/geekan/MetaGPT/blob/main/examples/di/README.md), a powerful agent capable of solving a wide range of real-world problems.
Expand Down
11 changes: 5 additions & 6 deletions examples/aflow/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -37,15 +37,14 @@ For custom tasks, you can reference the code in the `metagpt/ext/aflow/benchmark
1. Configure optimization parameters:
- Use command line arguments or modify default parameters in `examples/aflow/optimize.py`:
```python
--dataset MATH # Dataset type (HumanEval/MBPP/GSM8K/MATH/HotpotQA/DROP)
--dataset # (Required) Dataset type (HumanEval/MBPP/GSM8K/MATH/HotpotQA/DROP)
--sample 4 # Sample count - number of workflows to be resampled
--question_type math # Question type (math/code/qa)
--optimized_path PATH # Optimized result save path
--initial_round 1 # Initial round
--max_rounds 20 # Max iteration rounds for AFLOW
--check_convergence # Whether to enable early stop
--validation_rounds 5 # Validation rounds for AFLOW
--if_first_optimize # Set True for first optimization, False afterwards
--if_first_optimize # Set True for first optimization, False afterwards
```

2. Configure LLM parameters in `config/config2.yaml` (see `examples/aflow/config2.example.yaml` for reference)
Expand All @@ -61,15 +60,15 @@ For custom tasks, you can reference the code in the `metagpt/ext/aflow/benchmark
7. Run the optimization:
```bash
# Using default parameters
python -m examples.aflow.optimize
python -m examples.aflow.optimize --dataset MATH

# Or with custom parameters
python -m examples.aflow.optimize --dataset MATH --sample 4 --question_type math
python -m examples.aflow.optimize --dataset MATH --sample n --optimized_path xxx ...
```

## Reproduce the Results in the Paper
1. We provide the raw data obtained from our experiments in this [link](https://drive.google.com/uc?export=download&id=1Sr5wjgKf3bN8OC7G6cO3ynzJqD4w6_Dv), including the workflows and prompts generated in each iteration, as well as their trajectories on the validation dataset. We also provide the optimal workflow for each dataset and the corresponding data on the test dataset. You can download these data using `metagpt/ext/aflow/data/download_data.py`.
2. You can directly reproduce our experimental results by running the scripts in `examples/aflow/experiments`.
2. You can directly reproduce our experimental results by use different `ExperimentConfig` of `examples/aflow/optimize.py`.


## Citation
Expand Down
53 changes: 0 additions & 53 deletions examples/aflow/experiments/optimize_drop.py

This file was deleted.

53 changes: 0 additions & 53 deletions examples/aflow/experiments/optimize_gsm8k.py

This file was deleted.

53 changes: 0 additions & 53 deletions examples/aflow/experiments/optimize_hotpotqa.py

This file was deleted.

54 changes: 0 additions & 54 deletions examples/aflow/experiments/optimize_humaneval.py

This file was deleted.

53 changes: 0 additions & 53 deletions examples/aflow/experiments/optimize_math.py

This file was deleted.

54 changes: 0 additions & 54 deletions examples/aflow/experiments/optimize_mbpp.py

This file was deleted.

Loading

0 comments on commit bbb087b

Please sign in to comment.