Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

[DATALAB-2402]: Add Sphinx doc #1162

Open
wants to merge 156 commits into
base: develop
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
156 commits
Select commit Hold shift + click to select a range
240ef60
Merge pull request #592 from epam/EPMCDLAB-1748
Frikitrok Aug 17, 2018
0d588b5
added possibility to install different versions of the same library
Aug 17, 2018
413b6b4
Merge pull request #595 from epam/EPMCDLAB-1748
ioleksandr Aug 17, 2018
a91e4c4
fixed bug connected with multi version lib install
Aug 17, 2018
d9fc5bc
Merge pull request #603 from epam/EPMCDLAB-1748
ioleksandr Aug 23, 2018
a7a15c2
Reworked wrong describe filter to fix emr with spot creation error
Sep 2, 2018
3866d0e
Merge pull request #609 from epam/EPMCDLAB-1834-2.0
Frikitrok Sep 2, 2018
5d2cfc9
Release notes updated + version changed to 2.0
Sep 5, 2018
1e0b9d0
integration tests fixed to accept new liblist format
Aug 14, 2018
abf1918
Merge pull request #610 from epam/v2.0
EpamBohdanHliva Sep 5, 2018
69b0e83
fix error with creating spark clusters on Azure
ioleksandr Sep 7, 2018
6a15833
release notes updated
Sep 11, 2018
935c477
Merge pull request #617 from epam/v2.0.1
EpamBohdanHliva Sep 11, 2018
40f617e
[EPMCDLAB-1883]: Fixed Apache Toree link
Moskovych Oct 18, 2018
e49fefd
Updated release notes (v2.0.2)
Oct 18, 2018
db2054c
Merge pull request #647 from epam/bugfix-EPMCLDAB-1883
Moskovych Oct 18, 2018
36cdb38
Merge pull request #648 from epam/v2.0.2
EpamBohdanHliva Oct 18, 2018
6898f12
upgraded jackson version
Oct 26, 2018
a2a68ef
release notes updated
Nov 2, 2018
e031b67
Merge pull request #674 from epam/v2.0.3
EpamBohdanHliva Nov 2, 2018
693a00d
Readme updated
Nov 8, 2018
6e658cb
added script for deploying LDAP server
omartushevskyi Nov 26, 2018
34483ee
fixed typo
omartushevskyi Nov 26, 2018
a28cd70
DLAB-000 licence headers were updated for java and js files
Feb 27, 2019
3f640cb
DLAB-000 updated notice and licence files
Feb 27, 2019
356dc8f
DLAB-000 update license header for integration tests
Feb 27, 2019
da0d1e3
DLAB-000 updated license headers
Feb 28, 2019
0be895b
Merge pull request #19 from apache/ioleksandr-v2.1
EpamBohdanHliva Feb 28, 2019
4250cdb
bugfix
Dyoma33 Mar 11, 2019
c58dbf7
bugfix
Dyoma33 Mar 11, 2019
489a46b
Bugfix, moving execution of download_toree function to position when …
Dyoma33 Mar 11, 2019
8f1fe61
Bugfix, moving execution of download_toree function to position when …
Dyoma33 Mar 11, 2019
bb08944
Bugfix
Dyoma33 Mar 11, 2019
9cbd4ea
Bugfix
Dyoma33 Mar 11, 2019
ae65192
Bugfix
Dyoma33 Mar 11, 2019
fbf61c0
Deleted toree binaries from source code and wrote function that downl…
Dyoma33 Mar 11, 2019
b880de8
Refactored
Dyoma33 Mar 14, 2019
5426e9c
Fixed data engine creation issue
Dyoma33 Mar 14, 2019
021fd7e
Merge pull request #33 from Dyoma33/EPMCDLAB-328
omartushevskyi Mar 14, 2019
81a4d6c
DLAB-328 removed not needed function
Mar 14, 2019
0330055
Assigned role to ssn service account that allow to use BigQuery API, …
Dyoma33 Mar 14, 2019
71a8f09
Merge pull request #35 from Dyoma33/EPMCDLAB-v2.1.RC-2-529
omartushevskyi Mar 14, 2019
da232b2
[DLAB-318] fix DeepLearning creation for GCP
Dyoma33 Mar 14, 2019
b67bb9f
[DLAB-390] Fix for gcp entropy bug
Dyoma33 Mar 14, 2019
df366a5
Merge pull request #37 from Dyoma33/DLAB-318
EpamBohdanHliva Mar 14, 2019
2e16205
Merge pull request #38 from Dyoma33/DLAB-390
EpamBohdanHliva Mar 14, 2019
61553cd
Merge pull request #39 from apache/DLAB-380
EpamBohdanHliva Mar 14, 2019
3c6d952
[DLAB-532] Fixed matplotlib downloading bug
Dyoma33 Mar 15, 2019
86a3695
Merge pull request #42 from Dyoma33/DLAB-532
omartushevskyi Mar 15, 2019
1c5a96c
[DLAB-538]: fixed issue with roles updation in firefox
AndrianaKovalyshyn Mar 18, 2019
800594e
[DLAB-573]: fixed preemptible node validation
AndrianaKovalyshyn Mar 19, 2019
5090627
[DLAB-535] Updated debian image and set up installing linux-aws-hwe f…
Dyoma33 Mar 21, 2019
704d065
[DLAB-540] Updated nvidia drivers version
Dyoma33 Mar 21, 2019
9cbb53d
[DLAB-475] Parametrise also keras r package same as python library
ioleksandr Mar 21, 2019
6721041
[DLAB-535] Changed package name linux-modules-extra to linux-modules,…
Dyoma33 Mar 22, 2019
46bbb00
Merge pull request #52 from ioleksandr/DLAB-475
omartushevskyi Mar 22, 2019
cee729a
Merge pull request #55 from Dyoma33/DLAB-v.2.1-RC2-535
omartushevskyi Mar 22, 2019
0dfe94c
Merge pull request #48 from apache/v2.1-RC2-manage-roles-bugfix
EpamBohdanHliva Mar 25, 2019
c4e218a
[DLAB-535] Fixed instance creation issue due to missing -y flag and a…
Dyoma33 Mar 25, 2019
81c3180
Merge pull request #56 from Dyoma33/DLAB-535-RC
omartushevskyi Mar 25, 2019
25aae25
[DLAB-483]: fixed issue with reconfiguring Spark
omartushevskyi Mar 26, 2019
a6c1066
Merge pull request #61 from apache/DLAB-483-RC2
omartushevskyi Mar 26, 2019
0df8595
DLAB-527 fixed bug with azure billing
Mar 26, 2019
d3759ce
[DLAB-573]:fixed issue with azure_client_id
omartushevskyi Mar 27, 2019
8f7ba5d
[DLAB-573]: added needed parameters
omartushevskyi Mar 27, 2019
b1f47a1
DLAB-573 added refresh token param for spark reconfiguration
Mar 27, 2019
ff87b7c
Merge pull request #64 from apache/DLAB-573
omartushevskyi Mar 27, 2019
eaee0af
DLAB-000 fixed bug connected with cluster configuration dto
Mar 28, 2019
fa3075e
DLAB-000 2.1 Release notes updated
Mar 28, 2019
81ee1a0
DLAB-000 licence headers updated
Mar 28, 2019
2b61b23
DLAB-000 removed caffe tests
Apr 2, 2019
4983ba5
DLAB-000 fixed merge conflicts
Apr 15, 2019
d052709
Merge pull request #99 from apache/v2.1-master-merged
EpamBohdanHliva Apr 15, 2019
f9452d9
Bump nimbus-jose-jwt from 5.2 to 7.9 in /integration-tests
dependabot[bot] Nov 1, 2019
55362b7
DLAB documentation for v.2.1.1 (Ldap parameters as mandatory marked)
bodnarmykola Nov 1, 2019
842f8e4
Merge pull request #378 from bodnarmykola/DLAB_v.2.1.1_documentation
omartushevskyi Nov 1, 2019
9a96f84
gcp_dlab image for documentation uploaded
bodnarmykola Nov 1, 2019
b7cd69e
Created RC1
ofuks Nov 6, 2019
152e81d
Merge pull request #373 from apache/dependabot/maven/integration-test…
EpamBohdanHliva Nov 6, 2019
36a160b
Merge pull request #385 from apache/DLAB-1237
omartushevskyi Nov 7, 2019
d3ad0e7
Updated Copyright
ofuks Nov 7, 2019
5656d84
[DLAB-1249] Fixed secondary image creation
Dyoma33 Nov 8, 2019
e54c7cb
Merge pull request #389 from apache/DLAB-1249
omartushevskyi Nov 8, 2019
761b0ae
[DLAB-1230] Fixed billing issues [Azure]
ofuks Nov 8, 2019
bb4f91f
[DLAB-1230] Fixed billing issues with edges [Azure]
ofuks Nov 11, 2019
7229737
Code review
ofuks Nov 11, 2019
5156cdf
[DLAB-1242] Fixed predefined VPC and Subnet issue[GCP]
Dyoma33 Nov 11, 2019
90014b7
Merge pull request #395 from apache/DLAB-1242rc
omartushevskyi Nov 11, 2019
5913ba1
Code review
ofuks Nov 11, 2019
1b0e962
Merge pull request #392 from apache/DLAB-1230
EpamBohdanHliva Nov 12, 2019
0e85fdf
Fixed issue with custom ami;
omartushevskyi Nov 12, 2019
8a6df76
[DLAB-1256] Fixed issue with stopping notebook
ofuks Nov 12, 2019
3144fef
Merge pull request #398 from apache/custom-ami-fix-rc22
Dyoma33 Nov 12, 2019
e2b69be
[DLAB-1266] Fixed issue with switching between project for user (not …
ofuks Nov 13, 2019
b52ddb6
[DLAB-77] Temporarily removed tensor-rstudio template
Dyoma33 Nov 13, 2019
dd9310b
[DLAB-1260] Fixed bug with export billing report
ofuks Nov 13, 2019
0f462e3
[DLAB-1213]: added endpoint for admin project management
AndrianaKovalyshyn Nov 13, 2019
0025d43
[DLAB-1268]: added extra class for correct roles selection list
AndrianaKovalyshyn Nov 13, 2019
feb5021
[DLAB-1216]: fixed login redirect in case bad request error
AndrianaKovalyshyn Nov 13, 2019
7cc7459
Merge pull request #399 from apache/DLAB-1256
EpamBohdanHliva Nov 13, 2019
7da906b
Merge pull request #404 from apache/DLAB-1260
EpamBohdanHliva Nov 13, 2019
aaa2bc3
Code review
ofuks Nov 14, 2019
6686c8d
Fixed issue with supervisor conf file;
omartushevskyi Nov 14, 2019
1c09b85
Merge pull request #409 from apache/redhat-fix-rc22
bodnarmykola Nov 14, 2019
b09dade
Merge pull request #401 from apache/DLAB-1266
EpamBohdanHliva Nov 14, 2019
ab326aa
fixed issue with supervisor extension;
omartushevskyi Nov 14, 2019
3f614fc
Merge pull request #411 from apache/redhat-fix-rc22
bodnarmykola Nov 14, 2019
c595063
DLAB-000 fixed issue with unauthorized for web terminal
Nov 14, 2019
e1ff503
[DLAB-1214]: added request parameters to get project list per user (#…
AndrianaKovalyshyn Nov 14, 2019
ee198c4
[DLAB-1261] Custom image is unique per project
ofuks Nov 14, 2019
5172cf0
[DLAB-1265] Fixed bug with managing git credentials
ofuks Nov 14, 2019
5fa8f8d
Merge pull request #415 from apache/DLAB-1265-release
EpamBohdanHliva Nov 15, 2019
0549314
Merge pull request #413 from apache/DLAB-1261
EpamBohdanHliva Nov 15, 2019
074f4bb
Fixed issue with scheduler and quote
ofuks Nov 15, 2019
29b4849
[DLAB-1291]: Fixed issue with removing network interfaces on Azure;
omartushevskyi Nov 19, 2019
52e1cd6
Merge pull request #425 from apache/DLAB-terminate-fix
bodnarmykola Nov 19, 2019
8a35334
Updated Release notes
ofuks Nov 20, 2019
c44e5ab
Updated build.properties
ofuks Nov 20, 2019
b53889f
Updated license
ofuks Nov 20, 2019
350597c
changed DeepLearning version;
omartushevskyi Nov 20, 2019
4947b77
Merge pull request #431 from apache/deep-version-fix-rc22
bodnarmykola Nov 20, 2019
4dad16e
added configuration for gh-pages
Nov 21, 2019
167a8a9
Added the publish feature
ofuks Nov 22, 2019
6aed6af
Reverted the publish feature
ofuks Nov 22, 2019
36627c2
Delete integration-tests; added missing copyright
ofuks Nov 27, 2019
d81523d
added LICENSE.txt to Material Icons
AndrianaKovalyshyn Nov 27, 2019
42af2b9
Updated link
ViraVitan Nov 27, 2019
0ddc3bd
added publish website config
Nov 28, 2019
3fe716a
added publish website config
Nov 28, 2019
a56035e
[DLAB-1297]: fixed initial login issue
AndrianaKovalyshyn Nov 28, 2019
b337dac
Merge branch 'v2.2-RC1' of github.com:apache/incubator-dlab into v2.2…
AndrianaKovalyshyn Nov 28, 2019
a98f30d
[DLAB-1327] - Jupyter/DeepLearnin/TensorFlow creation fails fixed (ip…
bodnarmykola Dec 2, 2019
09abb2f
Merge pull request #468 from apache/DLAB-1327
Dyoma33 Dec 2, 2019
d3f47cf
updated License
AndrianaKovalyshyn Dec 2, 2019
22493d3
Update README.md
ViraVitan Dec 2, 2019
d97c8bf
Updated README
ofuks Dec 2, 2019
c06b904
Updated README
ofuks Dec 2, 2019
16172b9
Updated LICENSE
ofuks Dec 3, 2019
ee243d5
Merge v2.2-RC2
ofuks Dec 10, 2019
af995e9
Updated RELEASE_NOTES
ofuks Dec 10, 2019
dd90c35
[DLAB-1727]: Prevented 'Cloud Endpoint API' and Apache Zeppelin Ungit…
DG1202 Apr 22, 2020
0e219e9
Merge pull request #698 from apache/DLAB-1730
Dyoma33 Apr 22, 2020
92aca7b
Updated release_notes
ViraVitan Apr 23, 2020
e80f845
Merge pull request #704 from apache/DLAB-1680
bodnarmykola Apr 24, 2020
f12f7b6
[DLAB-1698]: Updated user guide according to release 2.3 (#692)
ViraVitan Apr 24, 2020
572d3b2
Merge remote-tracking branch 'origin/v2.3-RC1' into v2.3-RC1
ofuks Apr 24, 2020
c244866
changed version
ofuks Apr 24, 2020
09c6e45
deleted integration tests
ofuks Apr 24, 2020
ce38274
updated copyright
ofuks Apr 24, 2020
e1eab32
updated copyright
ofuks Apr 24, 2020
724250d
updated copyright
ofuks Apr 24, 2020
3b67611
updated copyright
ofuks Apr 24, 2020
09d2d7b
Merge remote-tracking branch 'remotes/origin/v2.3.0'
ofuks May 8, 2020
423fa3a
Updated labels in .asf.yaml
ofuks Oct 6, 2020
9475bd6
Fixed AWS IAM role in README.md
bodnarmykola Apr 14, 2021
fd395e5
- add sphinx doc for datalab_deploy.py
iakonk May 12, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
6 changes: 6 additions & 0 deletions .asf.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
github:
ghp_branch: gh-pages
labels:
- datalab
publish:
whoami: gh-pages
505 changes: 304 additions & 201 deletions README.md

Large diffs are not rendered by default.

89 changes: 49 additions & 40 deletions RELEASE_NOTES.md
Original file line number Diff line number Diff line change
@@ -1,60 +1,69 @@
#
# DLab is Self-service, Fail-safe Exploratory Environment for Collaborative Data Science Workflow

## New features in v2.2
## New features in v2.3

**All Cloud platforms:**
- added concept of Projects into DLab. Now users can unite under Projects and collaborate
- for ease of use we've added web terminal for all DLab Notebooks
- updated versions of installed software:
* angular 8.2.7
- Added support for multi-Cloud orchestration for AWS, Azure and GCP. Now, a single DLab instance can connect to the above Clouds, by means of respective set of API's, deployed on cloud endpoints;
- Added JupyterLab v.0.35.6 template
- Updated versions of installed software:
- Jupyter notebook v.6.0.2;
- Apache Zeppelin v.0.8.2;
- RStudio v.1.2.5033;
- Apache Spark v.2.4.4 for standalone cluster;

**AWS:**
- Added support of new version of Data Engine Service (EMR) v.5.28.0;

**GCP:**
- added billing report to monitor Cloud resources usage into DLab, including ability to manage billing quotas
- updated versions of installed software:
* Dataproc 1.3
- Added support of new version of Data Engine Service (Dataproc) v.1.4;
- Added new template Superset v.0.35.1;

## Improvements in v2.2
## Improvements in v2.3
**All Cloud platforms:**
- implemented login via KeyCloak to support integration with multiple SAML and OAUTH2 identity providers
- added DLab version into WebUI
- augmented ‘Environment management’ page
- added possibility to tag Notebook from UI
- added possibility to terminate computational resources via scheduler
- Grouped project management actions in single Edit project menu for ease of use;
- Introduced new "project admin" role;
- SSO now also works for Notebooks;
- Implemented ability to filter installed libraries;
- Added possibility to sort by project/user/charges in 'Billing report' page;
- Added test option for remote endpoint;

**GCP:**
- added possibility to create Notebook/Data Engine from an AMI image
## Bug fixes in v2.3
**All Cloud platforms:**
- Fixed a bug when Notebook name should be unique per project for different users, since it was impossible to operate Notebook with the same name after the first instance creation;
- Fixed a bug when administrator could not stop/terminate Notebook/computational resources created by another user;
- Fixed a bug when shell interpreter was not showing up for Apache Zeppelin;
- Fixed a bug when scheduler by start time was not triggered for Data Engine;
- Fixed a bug when it was possible to start Notebook if project quota was exceeded;
- Fixed a bug when scheduler for stopping was not triggered after total quota depletion;

**AWS and GCP:**
- UnGit tool now allows working with remote repositories over ssh
- implemented possibility to view Data Engine Service version on UI after creation
**AWS:**
- Fixed a bug when Notebook image/snapshot were still available after SSN termination;

## Bug fixes in v2.2
**All Cloud platforms:**
- fixed sparklyr library (r package) installation on RStudio, RStudio with TensorFlow notebooks
**Microsoft Azure:**
- Fixed a bug when custom image creation from Notebook failed and deleted the existing Notebook of another user;
- Fixed a bug when detailed billing was not available;
- Fixed a bug when spark reconfiguration failed on Data Engine;
- Fixed a bug when billing data was not available after calendar filter usage;

## Known issues in v2.3
**GCP:**
- fixed a bug when Data Engine creation fails for DeepLearning template
- fixed a bug when Jupyter does not start successfully after Data Engine Service creation (create Jupyter -> create Data Engine -> stop Jupyter -> Jupyter fails)
- fixed a bug when DeepLearning creation was failing

## Known issues in v2.2
**All Cloud platforms:**
- Notebook name should be unique per project for different users in another case it is impossible to operate Notebook with the same name after the first instance creation
- SSO is not available for Superset;

**Microsoft Azure:**
- DLab deployment is unavailable if Data Lake is enabled
- custom image creation from Notebook fails and deletes existed Notebook
- Notebook creation fails on RedHat;
- Web terminal is not working for Notebooks only for remote endpoint;

**Refer to the following link in order to view the other major/minor issues in v2.2:**
Refer to the following link in order to view the other major/minor issues in v2.3:

[Apache DLab: known issues](https://issues.apache.org/jira/issues/?filter=12347602 "Apache DLab: known issues")
[Apache DLab: known issues](https://issues.apache.org/jira/issues/?filter=12348876#](https://issues.apache.org/jira/issues/?filter=12348876 "Apache DLab: known issues")

## Known issues caused by cloud provider limitations in v2.2
## Known issues caused by cloud provider limitations in v2.3
**Microsoft Azure:**
- resource name length should not exceed 80 chars
- TensorFlow templates are not supported for Red Hat Enterprise Linux
- low priority Virtual Machines are not supported yet
- Resource name length should not exceed 80 chars;
- TensorFlow templates are not supported for RedHat Enterprise Linux;
- Low priority Virtual Machines are not supported yet;

**GCP:**
- resource name length should not exceed 64 chars
- billing data is not available
- **NOTE:** DLab has not been tested on GCP for Red Hat Enterprise Linux
- Resource name length should not exceed 64 chars;
- NOTE: DLab has not been tested on GCP for RedHat Enterprise Linux;
Loading