You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@@ -73,27 +73,22 @@ Join the [Slack channel](https://join.slack.com/t/ftioworkspace/shared_invite/zt
73
73
74
74
## Installation
75
75
76
-
FTIO is available on PYPI and can be easily installed via pip:
77
-
78
-
```sh
79
-
pip install ftio-hpc
80
-
```
81
-
82
-
For the latest GitHub version, FTIO can be installed either [automatically](#automated-installation) or [manually](#manual-installation). As a prerequisite,
76
+
FTIO is available on PYPI and can be easily installed via [pip](#automated-installation-from-pypi). For the latest GitHub version, FTIO can be installed either [automatically](#automated-installation) or [manually](#manual-installation). As a prerequisite,
83
77
for the virtual environment, `python3.11-venv` is needed, which can be installed on Ubuntu, for example, with:
84
78
85
79
```sh
86
80
apt install python3.11-venv
87
81
```
88
82
89
-
> [!note]
90
-
> Note there are currently issues with pyDarshan on Mac, that can be solved as mentioned [here](https://github.com/darshan-hpc/darshan/issues/930)
91
-
92
-
### Automated installation
83
+
If you want to contribute to the code, we advise that you install FTIO as mentioned under [contributing](#contributing).
84
+
### Automated installation from GitHub
93
85
94
86
FTIO is installed by default in a virtual environment. For the automated installation, simply execute the command:
> Note there are currently issues with pyDarshan on Mac and windows, that can be solved as mentioned [here](https://github.com/darshan-hpc/darshan/issues/930)
135
+
136
136
<p align="right"><a href="#ftio">⬆</a></p>
137
137
138
+
### Automated installation from PYPI
139
+
FTIO is available on PYPI and can be easily installed via pip:
140
+
141
+
```sh
142
+
pip install ftio-hpc
143
+
```
144
+
145
+
> [!note]
146
+
> Note there are currently issues with pyDarshan on Mac and windows, that can be solved as mentioned [here](https://github.com/darshan-hpc/darshan/issues/930)
147
+
148
+
138
149
## Usage
139
150
140
151
For installation instructions see [installation](#installation).
@@ -204,24 +215,102 @@ Several flags can be specified. The most relevant settings are:
204
215
205
216
## Testing
206
217
207
-
There is a `8.jsonl` file provided for testing under [examples](https://github.com/tuda-parallel/FTIO/tree/main/examples). On your system, navigate to the folder [examples/tmio/JSONL](https://github.com/tuda-parallel/FTIO/tree/main/examples/tmio/JSONL) and call:
218
+
There is a `8.jsonl` file provided for testing under [examples](https://github.com/tuda-parallel/FTIO/tree/main/examples).
219
+
On your system, navigate to the folder [examples/tmio/JSONL](https://github.com/tuda-parallel/FTIO/tree/main/examples/tmio/JSONL) and call:
208
220
209
221
```sh
210
222
ftio 8.jsonl
211
223
```
224
+
225
+
## Examples
226
+
Several examples are provided under [examples](https://github.com/tuda-parallel/FTIO/tree/main/examples).
212
227
See also the examples provided [here](/docs/file_formats.md#file-formats-and-tools) for the different file formats.
228
+
229
+
Alternatively, the [artifact folder](https://github.com/tuda-parallel/FTIO/tree/main/artifacts/ipdps24) contains several instructions and examples traces
230
+
from the [FTIO paper](#citation) that can be simply downloaded as described [here](https://github.com/tuda-parallel/FTIO/tree/main/artifacts/ipdps24#extracting-the-data-set).
231
+
232
+
As `ftio` supports Darshan traces, you could download also traces from [https://hpcioanalysis.zdv.uni-mainz.de/](https://hpcioanalysis.zdv.uni-mainz.de/) and execute FTIO on them as described [here](https://github.com/tuda-parallel/FTIO/blob/main/docs/file_formats.md#darshan).
233
+
234
+
For an online example with `predictor`, you can follow the instructions here for [HACC-IO](https://github.com/tuda-parallel/FTIO/tree/main/artifacts/ipdps24/HACC-IO#ftio-online-evaluation).
235
+
213
236
<palign="right"><ahref="#ftio">⬆</a></p>
214
237
215
238
<!-- CONTRIBUTING -->
216
239
## Contributing
217
240
218
-
If you have a suggestion that would make this better, please fork the repository and create a pull request.
219
241
220
-
1. Fork the project
221
-
2. Create your feature branch (`git checkout -b feature/AmazingFeature`)
222
-
3. Commit your changes (`git commit -m 'Add some AmazingFeature'`)
223
-
4. Push to the branch (`git push origin feature/AmazingFeature`)
224
-
5. Open a pull request
242
+
### Step 1: Fork the Repository
243
+
1. Visit the [FTIO GitHub repository](https://github.com/tuda-parallel/FTIO).
244
+
2. Click the **Fork** button in the top-right corner to create a copy of the repository under your GitHub account.
245
+
246
+
### Step 2: Clone Your Fork
247
+
Clone the forked repository to your local machine:
Before starting your work, create an issue on the repository to describe the feature, bug fix, or enhancement you plan to implement. This helps us track contributions and avoids duplicate work.
278
+
279
+
1. Go to the **Issues** tab in the [FTIO repository](https://github.com/tuda-parallel/FTIO).
280
+
2. Click **New Issue** and provide a clear title and description.
281
+
3. Label the issue appropriately (e.g., `enhancement`, `bug`, or `question`).
282
+
283
+
### Step 7: Make Your Changes
284
+
1. Create a new branch for your changes:
285
+
```bash
286
+
git checkout -b <your-feature-branch>
287
+
```
288
+
Replace `<your-feature-branch>` with a descriptive name for your branch.
289
+
290
+
2. Make your desired changes and commit them:
291
+
```bash
292
+
git add .
293
+
git commit -m "Description of your changes"
294
+
```
295
+
296
+
### Step 8: Push Your Changes
297
+
Push your changes to your forked repository:
298
+
```bash
299
+
git push origin <your-feature-branch>
300
+
```
301
+
302
+
303
+
## Step 9: Create a Pull Request to the `development` Branch
304
+
1. Navigate to the original FTIO repository on GitHub.
305
+
2. Click the **Pull Requests** tab, then click **New Pull Request**.
306
+
3. Set the target branch to `development`:
307
+
-**Base Repository:**`tuda-parallel/FTIO`
308
+
-**Base Branch:**`development`
309
+
-**Compare Branch:**`<your-feature-branch>`
310
+
4. Provide a detailed description of your changes, referencing the issue you created earlier (e.g., `Fixes #123`).
311
+
5. Submit your pull request and wait for feedback from the maintainers.
- If you didn't install `ftio`, first check out version 0.0.1 as described [here](/artifacts/ipdps24/README.md#ftio-version), then install it as described [here](https://github.com/tuda-parallel/FTIO#installation).
36
+
- If you didn't install `ftio`, first check out version 0.0.1 as described [here](/artifacts/ipdps24/README.md#ftio-version), then install it as described [here](https://github.com/tuda-parallel/FTIO#installation). If you don't want to reproduce the experiment from the paper but rather just try FTIO online, then you can skip checking out to a particular version.
37
37
38
-
In case you are interested in the original, it is [here](https://github.com/glennklockwood/hacc-io). For our experiments, we modified the code such that it is executed in a loop.
39
-
Navigate to the folder where the source code of the _modified_ version of HACC-IO is presented in `data/application_traces/HACC-IO/src`. Modify the provided Makefile to point to your TMIO git repository:
38
+
In case you are interested in the original version of the benchmark, it is [here](https://github.com/glennklockwood/hacc-io). For our experiments, we modified the code such that it is executed in a loop.
39
+
Navigate to the folder where the source code of the _modified_ version of HACC-IO is presented in `data/application_traces/HACC-IO/src` or clone it from here:
40
+
41
+
```bash
42
+
git clone https://github.com/A-Tarraf/hacc-io.git
43
+
```
44
+
45
+
Modify the provided Makefile to point to your TMIO git repository:
40
46
41
47
```bash
42
48
⋮
43
49
TMIO_REPO= /d/github/TMIO #modify this line
44
50
⋮
45
-
46
51
```
47
52
48
53
A provided Makefile takes care of including TMIO into the HACC-IO source code. For that, execute:
0 commit comments