Skip to content

Commit

Permalink
sync
Browse files Browse the repository at this point in the history
  • Loading branch information
ViktorAxelsen committed Oct 14, 2024
1 parent f2e6834 commit 1441e58
Show file tree
Hide file tree
Showing 4 changed files with 19 additions and 24 deletions.
15 changes: 3 additions & 12 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -40,9 +40,8 @@

## News

<!-- **[2024.10.1x]** 🌟Release AcademicEval -->
**[2024.10.1x]** 🌟 GoR is released.
<!-- **[2024.10.1x]** 🌟Release Thought Retriever -->
**[2024.10.16]** 🌟 GoR is released.



## 📌Preliminary
Expand Down Expand Up @@ -139,20 +138,12 @@ python sum_eval.py --cuda 0 --file_name ./result/[DATASET].json





## Acknowledgments

x



## Citation

```bibtex
@article{GoR,
title={Graph of Records: Boosting Retrieval Augmented Generation for Long-context Summarization with Graphs},
author={Haozhen Zhang and Tao Feng and Jiaxuan You*},
author={Haozhen Zhang and Tao Feng and Jiaxuan You},
journal={arXiv preprint arXiv:xxx},
year={2024}
}
Expand Down
28 changes: 16 additions & 12 deletions docs/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -87,17 +87,16 @@
<h1 class="title is-1 publication-title">Graph of Records: Boosting Retrieval Augmented Generation for Long-context Summarization with Graphs</h1>
<div class="is-size-5 publication-authors">
<span class="author-block">
<a>Haozhen Zhang</a><sup>1</sup>,</span>
<a>Haozhen Zhang</a>,</span>
<span class="author-block">
<a>Tao Feng</a><sup>2</sup>,</span>
<a>Tao Feng</a>,</span>
<span class="author-block">
<a>Jiaxuan You</a><sup>2</sup>,
<a>Jiaxuan You</a>,
</span>
</div>

<div class="is-size-5 publication-authors">
<span class="author-block"><sup>1</sup>Tsinghua University,</span>
<span class="author-block"><sup>2</sup>University of Illinois at Urbana-Champaign</span>
<span class="author-block">University of Illinois at Urbana-Champaign</span>
</div>

<div class="column has-text-centered">
Expand Down Expand Up @@ -170,12 +169,16 @@ <h2 class="title is-3">Abstract</h2>
<h2 class="title is-3">Graph of Records (GoR)</h2>
<div class="content has-text-justified">
<p>
Test.
GoR randomly selects text chunks from long documents to feed into LLMs for query simulation,
which are saved as a self-supervised training corpus and further used for graph construction inspired by the
retrieve-then-generate paradigm in RAG. For model training, GoR leverages GNNs to obtain node embeddings and calculate their
similarities to the query embedding. Finally, GoR features contrastive learning and pair-wise ranking objectives based on the
node ranking list derived from BERTScore calculation.
</p>
</div>
<div>
<img src="./static/figs/RAG.png" alt="model figure" width="200px"/>
<p>Model Figure</p>
<img src="./static/figs/model.png" alt="model figure" width="200px"/>
<p>GoR Model Architecture</p>
</div>
</div>
</div>
Expand All @@ -191,11 +194,12 @@ <h2 class="title is-3">Graph of Records (GoR)</h2>
<h2 class="title is-3">Experiments</h2>
<div class="content has-text-justified">
<p>
Test.
Experimental results on QMSum, AcademicEval, WCEP, and BookSum datasets over long-context global summarization tasks w.r.t. Rouge-L (R-L),
Rouge-1 (R-1), and Rouge-2 (R-2).
</p>
</div>
<img src="./static/figs/RAG.png" alt="model figure" width="200px"/>
<p>Results</p>
<img src="./static/figs/result.jpg" alt="experimental results" width="200px"/>
<p>Experimental Results</p>
</div>
</div>
</div>
Expand All @@ -207,7 +211,7 @@ <h2 class="title is-3">Experiments</h2>
<div class="container is-max-desktop content">
<h2 class="title">BibTeX</h2>
<pre><code>@article{GoR,
author = {Haozhen Zhang and Tao Feng and Jiaxuan You*},
author = {Haozhen Zhang and Tao Feng and Jiaxuan You},
title = {Graph of Records: Boosting Retrieval Augmented Generation for Long-context Summarization with Graphs},
journal = {arXiv preprint arXiv:xxx},
year = {2024},
Expand Down
Binary file added docs/static/figs/model.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/static/figs/result.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 1441e58

Please sign in to comment.