Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clean up analysis folder for final report #194

Merged
merged 6 commits into from
Jun 22, 2024
Merged

Clean up analysis folder for final report #194

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
67bf4cc
run gpt-4-turbo
Jun 21, 2024
c329d80
saved run
Jun 21, 2024
4dd85d6
Merge branch 'main' into clean-up-analysis-for-final-report
Jun 21, 2024
6036458
put all the report related files under report/
Jun 22, 2024
4488e04
fixed the images in final_report.qmd
Jun 22, 2024
21ef07d
fixed images in proposal
Jun 22, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 6 additions & 1 deletion .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
draft/*
**/*~
.env
/data/

# vim swap files
**/*~
Expand All @@ -18,4 +19,8 @@ draft/*
dist/

# pytest-cov coverage files
.coverage*
.coverage*

# quarto github page related
/.quarto/
/_site/
8 changes: 4 additions & 4 deletions report/final_report/_quarto.yml → _quarto.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
project:
type: website
render:
- "*qmd"
output-dir: docs
- "report/*qmd"
output-dir: report/docs

website:
sidebar:
Expand All @@ -11,9 +11,9 @@ website:
search: true
contents:
- text: "Capstone Final Report"
href: final_report.qmd
href: report/final_report.qmd
- text: "Capstone Proposal"
href: proposal.qmd
href: report/proposal.qmd

format:
html:
Expand Down
8 changes: 5 additions & 3 deletions analysis/batch_run.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,14 +25,16 @@ def main(config_yml):
from_dir = config['repo_base_path']
to_dir = config['response_path']
repos = config['repo']
model = config['model']

record = []
for repo in tqdm(repos):
for run in range(1, runs+1):
action.evaluate(
repo_path=os.path.join(from_dir, repo['path']),
save_to=f"{to_dir}/{repo['name']}_{"{:02d}".format(run)}.json",
checklist_path=checklist_path
save_response_to=f"{to_dir}/{repo['name']}_{"{:02d}".format(run)}.json",
checklist_path=checklist_path,
model=model
)

record.append({
Expand All @@ -43,4 +45,4 @@ def main(config_yml):
with open(f"{to_dir}/record.yml", 'w') as file:
yaml.dump(record, file)

fire.Fire(main)
fire.Fire(main)
45 changes: 23 additions & 22 deletions analysis/batch_run.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,27 +1,28 @@
runs: 30
runs: 28
checklist_path: null
model: 'gpt-4-turbo'
repo_base_path: '../data/raw/openja/'
response_path: '../data/processed/batch_run'
response_path: '../data/processed/batch_run_4-turbo'
repo:
- name: lightfm
path: './lightfm'
- name: qlib
path: './qlib'
- name: mmf
path: './mmf'
- name: nanodet
path: './nanodet'
- name: magenta
path: './magenta'
- name: nupic
path: './nupic'
- name: DeepSpeech
path: './DeepSpeech'
- name: apollo
path: './apollo'
- name: 'paperless-ng'
path: './paperless-ng'
- name: 'mycroft-core'
path: './mycroft-core'
- name: deepchem
path: './deepchem'
# - name: qlib
# path: './qlib'
# - name: mmf
# path: './mmf'
# - name: nanodet
# path: './nanodet'
# - name: magenta
# path: './magenta'
# - name: nupic
# path: './nupic'
# - name: DeepSpeech
# path: './DeepSpeech'
# - name: apollo
# path: './apollo'
# - name: 'paperless-ng'
# path: './paperless-ng'
# - name: 'mycroft-core'
# path: './mycroft-core'
# - name: deepchem
# path: './deepchem'
Empty file removed docs/.nojekyll
View file
Open in desktop
Empty file.
8 changes: 0 additions & 8 deletions docs/index.html
View file
Open in desktop

This file was deleted.

689 changes: 0 additions & 689 deletions docs/proposal.html
View file
Open in desktop

This file was deleted.

0 docs/img/checklist_sample.png → img/checklist_sample.png
View file
Open in desktop
File renamed without changes
0 docs/img/test_evaluation_report_sample.png → img/test_evaluation_report_sample.png
View file
Open in desktop
File renamed without changes
0 docs/img/test_spec_sample.png → img/test_spec_sample.png
View file
Open in desktop
File renamed without changes
0 ...inal_report/docs/img/checklist_sample.png → report/docs/img/checklist_sample.png
View file
Open in desktop
File renamed without changes
0 docs/img/logo.png → report/docs/img/logo.png
View file
Open in desktop
File renamed without changes
0 docs/img/proposed_system_overview.png → report/docs/img/proposed_system_overview.png
View file
Open in desktop
File renamed without changes
0 ...ocs/img/test_evaluation_report_sample.png → ...ocs/img/test_evaluation_report_sample.png
View file
Open in desktop
File renamed without changes
0 ...inal_report/docs/img/test_spec_sample.png → report/docs/img/test_spec_sample.png
View file
Open in desktop
File renamed without changes
8 changes: 8 additions & 0 deletions report/docs/index.html
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<title>Redirect to report/final_report.html</title>
<meta http-equiv="refresh" content="0;URL='report/final_report.html'" />
</head>
<body>
</body>
</html>
124 changes: 62 additions & 62 deletions docs/final_report.html → report/docs/report/final_report.html
View file
Open in desktop

Large diffs are not rendered by default.

42 changes: 21 additions & 21 deletions report/final_report/docs/proposal.html → report/docs/report/proposal.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -42,22 +42,22 @@
}</style>


<script src="site_libs/quarto-nav/quarto-nav.js"></script>
<script src="site_libs/quarto-nav/headroom.min.js"></script>
<script src="site_libs/clipboard/clipboard.min.js"></script>
<script src="site_libs/quarto-search/autocomplete.umd.js"></script>
<script src="site_libs/quarto-search/fuse.min.js"></script>
<script src="site_libs/quarto-search/quarto-search.js"></script>
<meta name="quarto:offset" content="./">
<script src="site_libs/quarto-html/quarto.js"></script>
<script src="site_libs/quarto-html/popper.min.js"></script>
<script src="site_libs/quarto-html/tippy.umd.min.js"></script>
<script src="site_libs/quarto-html/anchor.min.js"></script>
<link href="site_libs/quarto-html/tippy.css" rel="stylesheet">
<link href="site_libs/quarto-html/quarto-syntax-highlighting.css" rel="stylesheet" id="quarto-text-highlighting-styles">
<script src="site_libs/bootstrap/bootstrap.min.js"></script>
<link href="site_libs/bootstrap/bootstrap-icons.css" rel="stylesheet">
<link href="site_libs/bootstrap/bootstrap.min.css" rel="stylesheet" id="quarto-bootstrap" data-mode="light">
<script src="../site_libs/quarto-nav/quarto-nav.js"></script>
<script src="../site_libs/quarto-nav/headroom.min.js"></script>
<script src="../site_libs/clipboard/clipboard.min.js"></script>
<script src="../site_libs/quarto-search/autocomplete.umd.js"></script>
<script src="../site_libs/quarto-search/fuse.min.js"></script>
<script src="../site_libs/quarto-search/quarto-search.js"></script>
<meta name="quarto:offset" content="../">
<script src="../site_libs/quarto-html/quarto.js"></script>
<script src="../site_libs/quarto-html/popper.min.js"></script>
<script src="../site_libs/quarto-html/tippy.umd.min.js"></script>
<script src="../site_libs/quarto-html/anchor.min.js"></script>
<link href="../site_libs/quarto-html/tippy.css" rel="stylesheet">
<link href="../site_libs/quarto-html/quarto-syntax-highlighting.css" rel="stylesheet" id="quarto-text-highlighting-styles">
<script src="../site_libs/bootstrap/bootstrap.min.js"></script>
<link href="../site_libs/bootstrap/bootstrap-icons.css" rel="stylesheet">
<link href="../site_libs/bootstrap/bootstrap.min.css" rel="stylesheet" id="quarto-bootstrap" data-mode="light">
<script id="quarto-search-options" type="application/json">{
"location": "sidebar",
"copy-button": false,
Expand Down Expand Up @@ -92,7 +92,7 @@
<button type="button" class="quarto-btn-toggle btn" data-bs-toggle="collapse" data-bs-target="#quarto-sidebar,#quarto-sidebar-glass" aria-controls="quarto-sidebar" aria-expanded="false" aria-label="Toggle sidebar navigation" onclick="if (window.quartoToggleHeadroom) { window.quartoToggleHeadroom(); }">
<i class="bi bi-layout-text-sidebar-reverse"></i>
</button>
<nav class="quarto-page-breadcrumbs" aria-label="breadcrumb"><ol class="breadcrumb"><li class="breadcrumb-item"><a href="./proposal.html">Capstone Proposal</a></li></ol></nav>
<nav class="quarto-page-breadcrumbs" aria-label="breadcrumb"><ol class="breadcrumb"><li class="breadcrumb-item"><a href="../report/proposal.html">Capstone Proposal</a></li></ol></nav>
<a class="flex-grow-1" role="button" data-bs-toggle="collapse" data-bs-target="#quarto-sidebar,#quarto-sidebar-glass" aria-controls="quarto-sidebar" aria-expanded="false" aria-label="Toggle sidebar navigation" onclick="if (window.quartoToggleHeadroom) { window.quartoToggleHeadroom(); }">
</a>
<button type="button" class="btn quarto-search-button" aria-label="" onclick="window.quartoOpenSearch();">
Expand All @@ -106,8 +106,8 @@
<!-- sidebar -->
<nav id="quarto-sidebar" class="sidebar collapse collapse-horizontal sidebar-navigation docked overflow-auto">
<div class="pt-lg-2 mt-2 text-left sidebar-header">
<a href="./index.html" class="sidebar-logo-link">
<img src="./img/logo.png" alt="" class="sidebar-logo py-0 d-lg-inline d-none">
<a href="../index.html" class="sidebar-logo-link">
<img src="../img/logo.png" alt="" class="sidebar-logo py-0 d-lg-inline d-none">
</a>
</div>
<div class="mt-2 flex-shrink-0 align-items-center">
Expand All @@ -119,13 +119,13 @@
<ul class="list-unstyled mt-1">
<li class="sidebar-item">
<div class="sidebar-item-container">
<a href="./final_report.html" class="sidebar-item-text sidebar-link">
<a href="../report/final_report.html" class="sidebar-item-text sidebar-link">
<span class="menu-text">Capstone Final Report</span></a>
</div>
</li>
<li class="sidebar-item">
<div class="sidebar-item-container">
<a href="./proposal.html" class="sidebar-item-text sidebar-link active">
<a href="../report/proposal.html" class="sidebar-item-text sidebar-link active">
<span class="menu-text">Capstone Proposal</span></a>
</div>
</li>
Expand Down
1 change: 1 addition & 0 deletions report/docs/robots.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
Sitemap: https://UBC-MDS.github.io/fixml/sitemap.xml
Loading
Loading