Skip to content

Commit

Permalink
pre 2.2 release
Browse files Browse the repository at this point in the history
Signed-off-by: Julien Nioche <[email protected]>
  • Loading branch information
jniocheCF committed Jan 11, 2022
1 parent d9dafef commit ab9da4d
Show file tree
Hide file tree
Showing 3 changed files with 5 additions and 5 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@

[![license](https://img.shields.io/github/license/digitalpebble/storm-crawler.svg?maxAge=2592000?style=plastic)](http://www.apache.org/licenses/LICENSE-2.0)
![Build Status](https://github.com/DigitalPebble/storm-crawler/actions/workflows/maven.yml/badge.svg)
[![javadoc](https://javadoc.io/badge2/DigitalPebble/storm-crawler-core/2.1/javadoc.svg)](https://javadoc.io/doc/com.digitalpebble.stormcrawler/storm-crawler-core/2.1/index.html)
[![javadoc](https://javadoc.io/badge2/DigitalPebble/storm-crawler-core/javadoc.svg)](https://javadoc.io/doc/com.digitalpebble.stormcrawler/storm-crawler-core/)

StormCrawler is an open source collection of resources for building low-latency, scalable web crawlers on [Apache Storm](http://storm.apache.org/). It is provided under [Apache License](http://www.apache.org/licenses/LICENSE-2.0) and is written mostly in Java.

Expand All @@ -15,7 +15,7 @@ The version of Storm to use must match the one defined in the pom.xml file of yo

Once Storm is installed, the easiest way to get started is to generate a brand new StormCrawler project using \:

`mvn archetype:generate -DarchetypeGroupId=com.digitalpebble.stormcrawler -DarchetypeArtifactId=storm-crawler-archetype -DarchetypeVersion=2.1`
`mvn archetype:generate -DarchetypeGroupId=com.digitalpebble.stormcrawler -DarchetypeArtifactId=storm-crawler-archetype -DarchetypeVersion=2.2`

You'll be asked to enter a groupId (e.g. com.mycompany.crawler), an artefactId (e.g. stormcrawler), a version and package name.

Expand Down
2 changes: 1 addition & 1 deletion external/elasticsearch/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ Getting started

Use the archetype for Elasticsearch with:

`mvn archetype:generate -DarchetypeGroupId=com.digitalpebble.stormcrawler -DarchetypeArtifactId=storm-crawler-elasticsearch-archetype -DarchetypeVersion=2.1`
`mvn archetype:generate -DarchetypeGroupId=com.digitalpebble.stormcrawler -DarchetypeArtifactId=storm-crawler-elasticsearch-archetype -DarchetypeVersion=2.2`

You'll be asked to enter a groupId (e.g. com.mycompany.crawler), an artefactId (e.g. stormcrawler), a version and package name.

Expand Down
4 changes: 2 additions & 2 deletions external/warc/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ To configure the WARCHdfsBolt, include the following snippet in your crawl topol
.withPath(warcFilePath);

Map<String,String> fields = new HashMap<>();
fields.put("software:", "StormCrawler 2.1 http://stormcrawler.net/");
fields.put("software:", "StormCrawler 2.2 http://stormcrawler.net/");
fields.put("format", "WARC File Format 1.0");
fields.put("conformsTo:",
"https://iipc.github.io/warc-specifications/specifications/warc-format/warc-1.0/");
Expand Down Expand Up @@ -80,7 +80,7 @@ components:
- name: "put"
args:
- "software"
- "StormCrawler 2.1 http://stormcrawler.net/"
- "StormCrawler 2.2 http://stormcrawler.net/"
- name: "put"
args:
- "format"
Expand Down

0 comments on commit ab9da4d

Please sign in to comment.