Skip to content

Commit

Permalink
new data compass blog post
Browse files Browse the repository at this point in the history
  • Loading branch information
ronikobrosly committed Feb 22, 2025
1 parent 757fc91 commit 1fbdb05
Show file tree
Hide file tree
Showing 15 changed files with 889 additions and 211 deletions.
Binary file modified .lektor/buildstate
Binary file not shown.
6 changes: 4 additions & 2 deletions blog-tags/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -164,12 +164,14 @@ <h1><i class="fas fa-tag"></i> Tags</h1>
















Expand Down
18 changes: 17 additions & 1 deletion blog.xml
Original file line number Diff line number Diff line change
@@ -1,5 +1,21 @@
<?xml version="1.0" encoding="utf-8"?>
<feed xmlns="http://www.w3.org/2005/Atom"><title>Roni Kobrosly's Blog</title><link href="https://ronikobrosly.github.io/blog/" rel="alternate"></link><link href="https://ronikobrosly.github.io/blog.xml" rel="self"></link><id>urn:uuid:28e90109-04f4-39f8-8206-64e1555263f6</id><updated>2025-01-02T00:00:00Z</updated><author><name></name></author><entry><title>Some initial lessons from using Cursor to build a production web app</title><link href="https://ronikobrosly.github.io/blog/2025/1/2/lessons_from_cursor/" rel="alternate"></link><updated>2025-01-02T00:00:00Z</updated><author><name>Roni Kobrosly</name></author><id>urn:uuid:416d5792-9f3f-365b-8ae7-1ded8786d5c3</id><content type="html">&lt;p&gt;Happy New Year!&lt;/p&gt;
<feed xmlns="http://www.w3.org/2005/Atom"><title>Roni Kobrosly's Blog</title><link href="https://ronikobrosly.github.io/blog/" rel="alternate"></link><link href="https://ronikobrosly.github.io/blog.xml" rel="self"></link><id>urn:uuid:28e90109-04f4-39f8-8206-64e1555263f6</id><updated>2025-02-21T00:00:00Z</updated><author><name></name></author><entry><title>Data Compass AI is almost here!</title><link href="https://ronikobrosly.github.io/blog/2025/2/21/data_compass_is_coming/" rel="alternate"></link><updated>2025-02-21T00:00:00Z</updated><author><name>Roni Kobrosly</name></author><id>urn:uuid:0d229563-1f17-360e-bf92-14dbad5d04fe</id><content type="html">&lt;p&gt;Let me lead with the raison d'être of Data Compass AI.&lt;/p&gt;
&lt;p&gt;The data science and GenAI field is exploding. It's been called the sexiest job of the 21st century. Many data science and GenAI masters programs are springing up, creating armies of data scientists and GenAI engineers. The future of the field looks great right?&lt;/p&gt;
&lt;p&gt;Unfortunately many data scientists seem to be leaving the field in droves. Job satisfaction is quite low, and burnout is high. Most data science teams are completely ineffective from a business perspective. I would agree this has little to do with the talent of the data science indviduals. There are many reasons for this:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;When interviewing for potential data science roles, candidates are told the company has "mountains of data" and "endless exciting problems to tackle", but this is often not true.&lt;/li&gt;
&lt;li&gt;Companies have immature tech stacks, make data cleaning and productionizing models a nightmare.&lt;/li&gt;
&lt;li&gt;Company culture is not data-driven and data teams aren't first-class tech citizens (they're appendages expected to do magic) causing data scientists to struggle to get buy-in for their work.&lt;/li&gt;
&lt;li&gt;Data scientists are often siloed in their work, and don't get to work on the most interesting problems.&lt;/li&gt;
&lt;/ul&gt;
&lt;p&gt;Data Compass AI's mission is to make organizations' data maturity levels (be they large corporations, startups, non-profits, or government agencies) transparent to data job seekers and the data community. And also to allow organizations to see how their data maturity stacks up against others in their industry.&lt;/p&gt;
&lt;p&gt;I leveraged the AI-infused Cursor IDE heavily in the process and learned a TREMENDOUS amount about AI-assisted coding. Here are some lessons:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;AI coding assistants are &lt;strong&gt;phenomenial&lt;/strong&gt; debuggers. I would say they are orders of magnitude better at debugging than writing fresh code. This applies to AWS procedures, using common frameworks, dealing with git issues, etc. In my mind, the primary use case of AI assitants ought to be around debugging and fixing errors.&lt;/li&gt;
&lt;li&gt;Left to their own devices, AI coding assistant will forget minor details of existing coding, and replicate functionality. These causes cascading bugs. Developers must be vigilant. &lt;/li&gt;
&lt;li&gt;AI assistants work better when you continue long threads of conversation, versus opening a new thread for new areas of work. At least in the cause of Claude Sonnet 3.5, with each new thread, it seemed to forget the point of the web app and what the codebase looks like.&lt;/li&gt;
&lt;/ul&gt;
</content></entry><entry><title>Some initial lessons from using Cursor to build a production web app</title><link href="https://ronikobrosly.github.io/blog/2025/1/2/lessons_from_cursor/" rel="alternate"></link><updated>2025-01-02T00:00:00Z</updated><author><name>Roni Kobrosly</name></author><id>urn:uuid:416d5792-9f3f-365b-8ae7-1ded8786d5c3</id><content type="html">&lt;p&gt;Happy New Year!&lt;/p&gt;
&lt;p&gt;Over the holiday break, I had the opportunity to try out the &lt;a href="https://www.cursor.com/"&gt;Cursor Pro&lt;/a&gt;, one of the newer and more discussed GenAI coding assistants and IDE. It is meant to be like GitHub CoPilot, but the idea is it is its own IDE and AI is infused into each aspect of it:&lt;/p&gt;
&lt;ul&gt;
&lt;li&gt;It auto-completes lines&lt;/li&gt;
Expand Down
297 changes: 297 additions & 0 deletions blog/2025/2/21/data_compass_is_coming/index.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,297 @@
<!doctype html>

<head>
<!-- Google tag (gtag.js) -->
<script async src="https://www.googletagmanager.com/gtag/js?id=G-TT9MYHW754"></script>
<script>
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());

gtag('config', 'G-TT9MYHW754');
</script>
<meta name="viewport" content="width=device-width, initial-scale=1">
<meta charset="utf-8">
<style media="screen">
body {
padding-top: 70px;
padding-bottom: 70px;
}
</style>

<!-- Syntax Highlighter. Use pygments. -->
<link rel="stylesheet" href="../../../../../static/pygments.css">




<meta property="og:title" content="Data Compass AI is almost here!">
<meta property='og:url' content='http://ronikobrosly.github.io/blog//blog/data_compass_is_coming' />




<link rel="stylesheet" href="https://unpkg.com/[email protected]/dist/terminal.min.css" />


<style>
.blog-card-container {
display: flex;
}

.blog-card-left {
flex: 1;
}

.blog-card-right {
flex: 3;
}

</style>
<!-- Mathjax -->
<!-- <script type="text/javascript" async
src="https://cdnjs.cloudflare.com/ajax/libs/mathjax/2.7.5/latest.js?config=TeX-MML-AM_CHTML">
</script>
<script type="text/x-mathjax-config">
MathJax.Hub.Config({tex2jax: {inlineMath: [['$','$'], ['\\(','\\)']]}});
</script> -->

<script>
MathJax = {
tex: {
inlineMath: [['$', '$'], ['\\(', '\\)']]
},
svg: {
fontCache: 'global'
}
};
</script>
<script type="text/javascript" id="MathJax-script" async
src="https://cdn.jsdelivr.net/npm/mathjax@3/es5/tex-svg.js">
</script>

</head>

<title>Data Compass AI is almost here! - Roni Kobrosly's Personal Site</title>

<body>
<div class="container">
<h1 class="logo">
<a style="color:black" href="/">
Roni Kobrosly Ph.D.'s Website
</a>
</h1>
<!-- Top Navigation (local links) -->

<div class="terminal-nav">
<nav class="terminal-menu" id="local-links">
<ul>

<li class="menu-item">
<!-- Set blinking cursor correctly on navigation -->





<a href="/" rel="">Home</a>

</li>

<li class="menu-item">
<!-- Set blinking cursor correctly on navigation -->





<a class="terminal-prompt" href="/blog" rel="">Blog</a>

</li>

<li class="menu-item">
<!-- Set blinking cursor correctly on navigation -->





<a href="/open-source" rel="">Open Source</a>

</li>

<li class="menu-item">
<!-- Set blinking cursor correctly on navigation -->





<a href="/talks" rel="">Talks</a>

</li>

<li class="menu-item">
<!-- Set blinking cursor correctly on navigation -->





<a href="/art" rel="">Art</a>

</li>

<li class="menu-item">
<!-- Set blinking cursor correctly on navigation -->





<a href="/bio" rel="">Bio</a>

</li>

</ul>
</nav>
</div>

<!-- Body -->
<div id="body">



<div class="terminal-card">
<header id="post_title" name="post_title">
<!-- Set title style -->
<span name="title" id="title">Data Compass AI is almost here!</span>
</header>
<div class="card-body">

<!-- Append author -->
<small>
<p>
written by

Roni Kobrosly

on
<span id="pub_date" name="pub_date">2025-02-21</span>


| tags:
<!-- Append tags after author -->
<span class="boxed" id="tags" name="tags">
<a class="tags" href="../../../../tag/generative ai/">
generative ai
</a>
</span>
<span class="boxed" id="tags" name="tags">
<a class="tags" href="../../../../tag/engineering/">
engineering
</a>
</span>
<span class="boxed" id="tags" name="tags">
<a class="tags" href="../../../../tag/career/">
career
</a>
</span>
<span class="boxed" id="tags" name="tags">
<a class="tags" href="../../../../tag/data/">
data
</a>
</span>

</p>

</small>

<hr>


<img src="logo.webp" style="padding: 10px;" >


<span id="post_body" name="post_body">
<p>Let me lead with the raison d'être of Data Compass AI.</p>
<p>The data science and GenAI field is exploding. It's been called the sexiest job of the 21st century. Many data science and GenAI masters programs are springing up, creating armies of data scientists and GenAI engineers. The future of the field looks great right?</p>
<p>Unfortunately many data scientists seem to be leaving the field in droves. Job satisfaction is quite low, and burnout is high. Most data science teams are completely ineffective from a business perspective. I would agree this has little to do with the talent of the data science indviduals. There are many reasons for this:</p>
<ul>
<li>When interviewing for potential data science roles, candidates are told the company has "mountains of data" and "endless exciting problems to tackle", but this is often not true.</li>
<li>Companies have immature tech stacks, make data cleaning and productionizing models a nightmare.</li>
<li>Company culture is not data-driven and data teams aren't first-class tech citizens (they're appendages expected to do magic) causing data scientists to struggle to get buy-in for their work.</li>
<li>Data scientists are often siloed in their work, and don't get to work on the most interesting problems.</li>
</ul>
<p>Data Compass AI's mission is to make organizations' data maturity levels (be they large corporations, startups, non-profits, or government agencies) transparent to data job seekers and the data community. And also to allow organizations to see how their data maturity stacks up against others in their industry.</p>
<p>I leveraged the AI-infused Cursor IDE heavily in the process and learned a TREMENDOUS amount about AI-assisted coding. Here are some lessons:</p>
<ul>
<li>AI coding assistants are <strong>phenomenial</strong> debuggers. I would say they are orders of magnitude better at debugging than writing fresh code. This applies to AWS procedures, using common frameworks, dealing with git issues, etc. In my mind, the primary use case of AI assitants ought to be around debugging and fixing errors.</li>
<li>Left to their own devices, AI coding assistant will forget minor details of existing coding, and replicate functionality. These causes cascading bugs. Developers must be vigilant. </li>
<li>AI assistants work better when you continue long threads of conversation, versus opening a new thread for new areas of work. At least in the cause of Claude Sonnet 3.5, with each new thread, it seemed to forget the point of the web app and what the codebase looks like.</li>
</ul>

</span>







</div>

</div>




</div>

<!-- Bottom Navigation (external links) -->
<div class="terminal-nav">
<nav class="terminal-menu" id="local-links">
<ul>

<li class="nav-item">
<a class="nav-link" href="https://raw.githubusercontent.com/ronikobrosly/resume/main/kobrosly_data_jan_2025_IC.pdf" rel="">
Resume</a>
</li>

<li class="nav-item">
<a class="nav-link" href="https://www.linkedin.com/in/ronikobrosly" rel="">
LinkedIn</a>
</li>

<li class="nav-item">
<a class="nav-link" href="http://github.com/ronikobrosly" rel="">
GitHub</a>
</li>

<li class="nav-item">
<a class="nav-link" href="https://stackoverflow.com/users/2831487/slyron" rel="">
Stack Overflow</a>
</li>

<li class="nav-item">
<a class="nav-link" href="https://bsky.app/profile/slykoby.bsky.social" rel="">
Bluesky</a>
</li>

<li class="nav-item">
<a class="nav-link" href="https://scholar.google.com/scholar?hl=en&amp;as_sdt=0%2C21&amp;q=rw+kobrosly&amp;btnG=" rel="">
Publications</a>
</li>

<li class="nav-item">
<a class="nav-link" href="https://mail.google.com/mail/?view=cm&amp;fs=1&amp;[email protected]&amp;su=Hi! Reaching out from your personal website...&amp;body=blah blah blah" rel="">
Contact Me</a>
</li>

</ul>
</nav>
</div>

</div>
</body>
Binary file added blog/2025/2/21/data_compass_is_coming/logo.webp
Binary file not shown.
Loading

0 comments on commit 1fbdb05

Please sign in to comment.