Skip to content

Commit

Permalink
docs: slightly revised etl pic and caps
Browse files Browse the repository at this point in the history
  • Loading branch information
alex-aizman committed Dec 10, 2020
1 parent 8c56c4a commit be29c5a
Show file tree
Hide file tree
Showing 5 changed files with 9 additions and 5 deletions.
4 changes: 2 additions & 2 deletions deploy/dev/docker/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -227,13 +227,13 @@ Refer to the `logs.sh` script for more details about its usage.

### `get_ip_addresses.sh`

If you want to quickly get the ip addresses of each container of all clusters, use the following script:
If you'd want to quickly get IP addresses of all running containers, execute the following:

```console
$ ./get_ip_addresses.sh
```

* Note: The port numbers for the ip addresses for each container will be 51080, 9080, 10080 by default for the public, intra control and intra data networks respectively.
> The default port numbers will be `51080`, `9080`, and `10080` respectively for the **public**, **intra-control** and **intra-data** networks.
### Prune docker

Expand Down
4 changes: 4 additions & 0 deletions docs/etl.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,9 @@
# Extract, Transform, Load (ETL) with AIStore

**New** in v3.3: offline transformation and the capability to run user-defined functions (in addition to custom ETL containers). Also, bug fixes, performance improvements across the board, video and GIF presentations, and more.

<img src="images/etl-v3.3.png" width="450">

- [Introduction](#introduction)
- [Getting Started](#getting-started)
- [Inline ETL example](#inline-etl-example)
Expand Down
2 changes: 1 addition & 1 deletion docs/getting_started.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Getting Started

You could start running AIS on a single Linux or Mac host. Alternatively, or in addition, you could quickly deploy your first AIS cluster on [GCP/GKE](https://cloud.google.com/kubernetes-engine). This document introduces these and other supported options and provides quick links for further information.
You could run AIS on a single Linux or Mac machine. Or, you could quickly deploy your first AIS cluster on [GCP/GKE](https://cloud.google.com/kubernetes-engine) cloud. This document introduces these and other supported options and provides quick links for further information.

Generally, when deciding how to deploy a system like AIS with so many options to choose from, a good place to start would be answering the following two fundamental questions:

Expand Down
Binary file added docs/images/etl-v3.3.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
4 changes: 2 additions & 2 deletions docs/overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,12 +35,12 @@ Following is a high-level architecture with an emphasis on supported (frontend a

<img src="images/ais-block.png" alt="New in 3.1" width="700">

Most recently capabilities include:
Most recently added capabilities include:

- (**new**) [ETL offload](/etl/README.md): support for running custom extract-transform-load workloads on (and by) storage cluster;
- (**new**) TensorFlow integration to support existing training clients that use S3 API - done via `tar2tf` ETL offload that handles on the fly TFRecord/tf.Example conversion;

<img src="images/etl-v3.2.png" alt="ETL 1.0" width="450">
<img src="images/etl-v3.3.png" width="450">

- List objects v2: optimized `list-objects` to greatly reduce response times;
- (**new**) Query objects: extends `list-objects` with advanced filtering capabilities;
Expand Down

0 comments on commit be29c5a

Please sign in to comment.