Using Niyān
This guide is for researchers, machine-learning engineers, and other members of an organization that already runs a Niyān server. There are two ways to work with it.
Local and automated workThe niyan CLIAuthenticate, clone datasets, version local work, selectively download data, and use the Python client.Browser-based workThe user dashboardCreate and browse datasets, publish browser commits, manage groups and access, and control account security.
Niyān datasets are Git repositories whose large files are stored with Git LFS in S3-compatible object storage. Both surfaces operate on the same datasets, permissions, branches, commits, and access tokens.
Which should I use?
- Use the dashboard for discovery, occasional uploads, account settings, group membership, and access management.
- Use the CLI for working copies, directory trees, branches and tags, repeatable workflows, large-scale transfers, and project dependencies.
- Use the Python client included with the CLI package to stream files with fsspec.
If you prefer ordinary Git commands, read Standard Git and Git LFS for the differences you should expect.
What your administrator provides
You need:
- the full HTTPS URL of your Niyān server, such as
https://data.example.edu; - a Niyān user account; and
- access to at least one group or dataset.
Niyān does not support public registration. If you cannot sign in or cannot see the dataset you need, contact the administrator for your installation.