Skip to content

Commit

Permalink
update cv timeline
Browse files Browse the repository at this point in the history
  • Loading branch information
@csinva
csinva committed Oct 28, 2023
1 parent f25057c commit b519f4c
Show file tree
Hide file tree
Showing 3 changed files with 54 additions and 145 deletions.
171 changes: 37 additions & 134 deletions _includes/03_experience.html
View file
Original file line number Diff line number Diff line change
@@ -1,51 +1,52 @@
<h2 style="text-align: center;margin-top: -150px;"> experience </h2>

<ul class="timeline">
<li>
<li class="timeline-inverted">
<div class="timeline-image">
<img class="img-circle img-responsive" src="{{ site.baseurl }}/assets/img/msft.svg" alt="">
</div>
<div class="timeline-panel">
<div class="timeline-heading">
<p>Fall 22 - Present</p>
<h4 class="subheading">msr <a
<b style="font-size:x-large">microsoft research <a
href="https://www.microsoft.com/en-us/research/group/deep-learning-group/">(deep
learning lab)</a></h4>
</div>
<div class="timeline-body">
<p>large language models and explanations</p>
learning group)</a>
</b>
<br><br><i style="font-size:large">Summer 22 - Present<br></i><br>
<p> large language models and explanations </p>
</div>
</div>
</li>

<!--invert every other item-->
<li class="timeline-inverted">
<div class="timeline-image">
<img class="img-circle img-responsive" src="{{ site.baseurl }}/assets/img/paige.jpg" alt="">
</div>
<div class="timeline-panel">
<div class="timeline-heading">
<p>Summer 21 - Summer 22</p>
<h4 class="subheading">paige ai <a href="https://www.paige.ai/">(ai scientist)</a></h4>
</div>
<div class="timeline-body">
<p>developed deep learning models for pathology</p>
<b style="font-size:x-large">healthcare ai
</b>
<br><br><i style="font-size:large">Summer 21-Summer 22<br></i><br>
<p> worked at <a href="https://paige.ai/">paige ai</a> as a research scientist developing deep learning
models for
pathology -- also
worked at <a href="https://pacmed.ai/en/">pacmed ai</a> in summer 2019 and response4life covid
forecasting in spring 2020</p>
</div>
</div>
</li>

<li>
<li class="timeline-inverted">
<div class="timeline-image">
<img class="img-circle img-responsive" src="{{ site.baseurl }}/assets/img/berkeley.png" alt="">
</div>
<div class="timeline-panel">
<div class="timeline-heading">
<p>Fall 17 - spring 22</p>
<h4 class="subheading">berkeley <a href="https://www.stat.berkeley.edu/~binyu/Site/Welcome.html">(bin yu
lab)</a></h4>
</div>
<div class="timeline-body">
<p>phd research in interpretable ml</p>
<b style="font-size:x-large">phd at uc berkeley <a
href="https://www.stat.berkeley.edu/~binyu/Site/Welcome.html">(bin yu
group)</a>
</b>
<br><br><i style="font-size:large">Fall 17-Spring 23<br></i><br>
<p> worked on interpretable machine learning, especially for neural networks</p>
</div>
</div>
</li>
Expand All @@ -56,133 +57,35 @@ <h4 class="subheading">berkeley <a href="https://www.stat.berkeley.edu/~binyu/Si
</div>
<div class="timeline-panel">
<div class="timeline-heading">
<p>Summer 20</p>
<h4 class="subheading">amazon research <a
href="https://scholar.google.com/citations?user=j29kMCwAAAAJ&hl=en">(pietro perona lab)</a></h4>
</div>
<div class="timeline-body">
<p>causal benchmarking of fairness in computer vision models</p>
<b style="font-size:x-large">big tech internships
</b>
<br><br><i style="font-size:large">Summer 2017, Summer 2020<br></i><br>
<p> worked on unsupervised semantic segmentation at meta ai, and worked on causal fairness benchmarking
in computer vision at aws</p>
</div>
</div>
</li>

<li>
<div class="timeline-image">
<img class="img-circle img-responsive" src="{{ site.baseurl }}/assets/img/pacmed.png" alt="">
</div>
<div class="timeline-panel">
<div class="timeline-heading">
<p>Summer 19</p>
<h4 class="subheading">pacmed ai <a href="https://pacmed.ai/en/">(healthcare interpretability)</a></h4>
</div>
<div class="timeline-body">
<p>interpreting medical machine-learning models</p>
</div>
</div>
</li>

<li class="timeline-inverted">
<div class="timeline-image">
<img class="img-circle img-responsive" src="{{ site.baseurl }}/assets/img/fb.png" alt="">
</div>
<div class="timeline-panel">
<div class="timeline-heading">
<p>Summer 17</p>
<h4 class="subheading">meta ai <a href="https://ai.facebook.com/"> (computer
vision) </a></h4>
</div>
<div class="timeline-body">
<p>CNNs for semantic segmentation</p>
</div>
</div>
</li>

<li>
<div class="timeline-image">
<img class="img-circle img-responsive" src="{{ site.baseurl }}/assets/img/uva.png" alt="">
</div>
<div class="timeline-panel">
<div class="timeline-heading">
<p>Fall 16 - Spring 17</p>
<h4 class="subheading">uva <a href="https://www.cs.virginia.edu/yanjun/">(Yanjun Qi Lab)</a></h4>
<div class="timeline-heading">
<b style="font-size:x-large">undergrad
</b>
<br><br><i style="font-size:large">2014-2017<br></i><br>
<p> worked on graphical models under <a href="https://www.cs.virginia.edu/yanjun/">Yanjun
Qi</a>
and on biophysical modeling under <a href="http://faculty.virginia.edu/levylab/">William
Levy</a> -- was also lucky to spend three summers doing research at HHMI Janelia under <a
href="https://scholar.google.com/citations?user=V_NdI3sAAAAJ&hl=en&oi=ao">Srini Turaga</a>
</p>
</div>
</div>
<div class="timeline-body">
<p>improving multi-task graphical models</p>
</div>
</div>
</li>

<li class="timeline-inverted">
<div class="timeline-image">
<img class="img-circle img-responsive" src="{{ site.baseurl }}/assets/img/connectome.jpg" alt="">
</div>
<div class="timeline-panel">
<div class="timeline-heading">
<p>Summer 14, 15, 16</p>
<h4 class="subheading">hhmi <a
href="https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&ved=0ahUKEwik_6XR8vXWAhULz2MKHfemCs4QFggmMAA&url=https%3A%2F%2Fwww.janelia.org%2Fpeople%2Fsrini-turaga&usg=AOvVaw2bz69zeov78HQO7KQKxKSK">(Srini
Turaga Lab) </a></h4>
</div>
<div class="timeline-body">
<p>CNNs for neural-image segmentation</p>
</div>
</div>
</li>

<li>
<div class="timeline-image">
<img class="img-circle img-responsive" src="{{ site.baseurl }}/assets/img/uva.png" alt="">
</div>
<div class="timeline-panel">
<div class="timeline-heading">
<p>Fall 14 - Fall 16</p>
<h4 class="subheading">uva <a href="http://faculty.virginia.edu/levylab/">(William Levy Lab)</a></h4>
</div>
<div class="timeline-body">
<p>Biophysical neuron modeling</p>
</div>
</div>
</li>

<!-- <li class="timeline-inverted">-->
<!-- <div class="timeline-image">-->
<!-- <img class="img-circle img-responsive" src="{{ site.baseurl }}/assets/img/neuron.jpg" alt="">-->
<!-- </div>-->
<!-- <div class="timeline-panel">-->
<!-- <div class="timeline-heading">-->
<!-- <h4>Summer 14</h4>-->
<!-- <h4 class="subheading">hhmi <a-->
<!-- href="https://www.janelia.org/support-team/scientific-computing-software"> (Scientific-->
<!-- Computing) </a></h4>-->
<!-- </div>-->
<!-- <div class="timeline-body">-->
<!-- <p>Simulated extracellular neural recordings via Neurocube Matlab scripts</p>-->
<!-- </div>-->
<!-- </div>-->
<!-- </li>-->

<!-- <li>-->
<!-- <div class="timeline-image">-->
<!-- <img class="img-circle img-responsive" src="{{ site.baseurl }}/assets/img/rii.png" alt="">-->
<!-- </div>-->
<!-- <div class="timeline-panel">-->
<!-- <div class="timeline-heading">-->
<!-- <h4>Summer 13 - Spring 14</h4>-->
<!-- <h4 class="subheading">rii <a href="http://www.researchinnovations.com/">(web/android dev)</a></h4>-->
<!-- </div>-->
<!-- <div class="timeline-body">-->
<!-- <p>Developed web app for simultaneous task coordination + Android app to increase the data storage-->
<!-- capacity of QR codes.</p>-->
<!-- </div>-->
<!-- </div>-->
<!-- </li>-->


<!-- <li class="timeline-inverted">-->
<!-- <div class="timeline-image">-->
<!-- <img class="img-circle img-responsive" src="{{ site.baseurl }}/assets/img/default.jpg" alt="">-->
<!-- </div>-->
<!-- </li>-->
</ul>
<!--<hr>-->
<img src="{{ site.baseurl }}/assets/img/lab.gif" class="img-responsive" alt=""
Expand Down
6 changes: 5 additions & 1 deletion _notes/research_ovws/ovw_transformers.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -226,7 +226,7 @@ See related papers in the [📌 interpretability](https://csinva.io/notes/resear
![prompting_hierarchy](../assets/prompting_hierarchy.png)

- natural-language prompting
- iPrompt: Explaining Patterns in Data with Language Models via Interpretable Autoprompting ([singh, morris, ...gao, 2022](https://arxiv.org/abs/2210.01848))
- **iPrompt**: Explaining Patterns in Data with Language Models via Interpretable Autoprompting ([singh, morris, ...gao, 2022](https://arxiv.org/abs/2210.01848))
- APE: Large Language Models Are Human-Level Prompt Engineers ([zhou...ba, 2022](https://arxiv.org/abs/2211.01910))
- similar to iPrompt, (1) propose prompt candidates with an LLM, (2) score the prompts by the accuracy they yield when using another LLM and (3) regenerate similar prompt candidates
- experiments on instruction induction datasets + truthful QA
Expand All @@ -236,6 +236,7 @@ See related papers in the [📌 interpretability](https://csinva.io/notes/resear
- OPRO: Large Language Models as Optimizers ([yang...quoc le, zhou, & chen , 2023](https://arxiv.org/abs/2309.03409)) - add in past prompts with their scores during optimization
- Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolution ([fernando...rocktaschel, 2023](https://arxiv.org/abs/2309.16797)) - simultaneously improve prompts with LLM + improve the *mutation-prompts* the LLM uses to mutate the prompts
- Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers ([guo...yang, 2023](https://arxiv.org/abs/2309.08532))
- PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization ([wang...hu, 2023](https://arxiv.org/abs/2310.16427)) - iterate on prompt errors using MC tree search
- Language Models as Black-Box Optimizers for Vision-Language Models ([yu...pathak, & ramanan, 2023](https://arxiv.org/pdf/2309.05950v1.pdf))
- discrete prompting
- AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts ([shin...sameer singh, 2020](https://aclanthology.org/2020.emnlp-main.346/))
Expand Down Expand Up @@ -543,6 +544,9 @@ See related papers in the [📌 interpretability](https://csinva.io/notes/resear

- Efficient Streaming Language Models with Attention Sinks ([xiao...lewis, 2023](https://arxiv.org/pdf/2309.17453.pdf))


- Codebook Features: Sparse and Discrete Interpretability for Neural Networks ([tamkin, taufeeque, & goodman, 2023](https://arxiv.org/abs/2310.17230))

## attention variants

- Tree Transformer: Integrating Tree Structures into Self-Attention ([wang, .., chen, 2019](https://arxiv.org/pdf/1909.06639.pdf))
Expand Down
22 changes: 12 additions & 10 deletions assets/css/timeline.css
View file
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@
position: absolute;
top: 0;
bottom: 0;
left: 40px;
left: 10px;
width: 2px;
margin-left: -1.5px;
background-color: #f1f1f1;
Expand All @@ -32,7 +32,7 @@
}

.timeline>li .timeline-panel {
float: right;
float: left;
position: relative;
width: 100%;
padding: 0 20px 0 100px;
Expand Down Expand Up @@ -74,7 +74,7 @@
}

.timeline>li.timeline-inverted>.timeline-panel {
float: right;
float: left;
padding: 0 20px 0 100px;
text-align: left;
}
Expand Down Expand Up @@ -113,23 +113,23 @@

@media(min-width:768px) {
.timeline:before {
left: 50%;
left:20%;
}

.timeline>li {
margin-bottom: 100px;
min-height: 100px;
margin-bottom: 25px;
min-height: 50px;
}

.timeline>li .timeline-panel {
float: left;
width: 41%;
width: 65%;
padding: 0 20px 20px 30px;
text-align: right;
}

.timeline>li .timeline-image {
left: 50%;
left: 20%;
width: 100px;
height: 100px;
margin-left: -50px;
Expand All @@ -142,9 +142,11 @@
}

.timeline>li.timeline-inverted>.timeline-panel {
float: right;
float: left;
padding: 0 30px 20px 20px;
text-align: left;
left: 30%;
/* left-margin XXX */
}
}

Expand All @@ -164,7 +166,7 @@
}

.timeline>li .timeline-image h4 {
margin-top: 30px;
margin-top: 10px;
font-size: 18px;
line-height: 26px;
}
Expand Down

0 comments on commit b519f4c

Please sign in to comment.