Topics

Type dataset

General open-data-registry

Integration aws s3

General aws-pds

General sustainability

General agriculture

General earth observation

General geospatial

General life sciences

General machine learning

General climate

Data Domain computer vision

General genomic

General weather

General satellite imagery

General meteorological

General biology

Type model

General genetic

General environmental

Task disaster response

General deep learning

General bioinformatics

General hacktoberfest

Data Domain audio

General natural resource

Task classification

General imaging

General natural language processing

Data Domain nlp

General cancer

General mlops

Integration mlflow

General image processing

General health

Data Domain tabular

General hacktoberfest 2023

General oceans

General python

Task image classification

Integration dvc

General mapping

General coastal

General whole genome sequencing

Framework tensorflow

General data science

General biodiversity

General atmosphere

General covid-19

General cog

General elevation

General strides

General neuroscience

General global

Integration git

General cities

General coronavirus

General lidar

General neuroimaging

General open source software

General ecosystems

General climate model

General water

Framework pytorch

General aerial imagery

General csv

General neurobiology

Task object detection

General land

General astronomy

General air quality

General archives

General transcriptomics

General machine learning project

General urban

General data science project

General analytics

General food security

General energy

General parquet

General bam

General internet

General continuously operating reference station - cors

General gps

Framework scikit-learn

General homo sapiens

General conservation

General tutorial

General encyclopedic

General stac

General cell biology

General fastq

General cell imaging

Data Domain 3d model

General broadcast ephemeris

General medicine

General gnss

General gene expression

General chemistry

General earthquakes

General nara

General json

General census

General robotics

General infrastructure

General biotech blueprint

General solar

General cyber security

General statistics

General magnetic resonance imaging

General signal processing

General labeled

General mlflow-serving

General demography

General protein

Data Domain medical imaging

General reference index

General molecule

Task autonomous vehicles

General ice

General cnn

General vcf

Task machine translation

General neural network

General mus musculus

Task vision

General transportation

General geoscience

General chemical biology

General 1940 census

Task information retrieval

General video

General genetic maps

General neurophysiology

General multimedia

General financial markets

General planetary

General biomolecular modeling

General microscopy

General population

General population genetics

General llm

General computer security

General regulatory

General floods

General osm

General electron microscopy

General marine navigation

General fasta

General streamlit

Task anomaly detection

General ml pipelines

Task time series forecasting

General deeplearning

General reproducibility-challenge

General wine quality prediction

General medical

General data visualization

Integration arxiv

General predictive analysis

Task text generation

General digital preservation

General xgboost

General data analytics

General market data

General genelab

Task denoising

General civic

Task semantic segmentation

General dagshub

General artificial-intelligence

General smd ai

General random forests

Integration label studio

General bathymetry

General short read sequencing

General epigenomics

General metadata

General broadband

General fluorescence imaging

General fast5

General sars

Integration github

General nifti

General survey

General long read sequencing

General commerce

General demographics

General copyright monitoring

General computer forensics

General traffic

General government records

General mers

General metagenomics

General seismology

General blockchain

General us-dc

Task chatbot

General amino acid

General molecular docking

General regression

General digital forensics

General genome wide association study

General rag

General economics

Task language modelling

Task sentiment analysis

General healthcare

General llms

General kaggle

General text analysis

General transformers

General segmentation

Task text classification

General events

General electrophysiology

General data cleaning

General network traffic

General projects

General datamanipulation

General music

General kidney

Framework huggingface transformers

General research

Task text-to-image generation

Data Domain graph

General github actions

General intrusion detection

Task music information retrieval

General forecast

General source code

General complaints

General x-ray tomography

General cloud computing

General free software

General cars

General education

General mining software repositories

General test

Task speech recognition

General trading

General txt

General deployment

General movies

General predictive modelling

Task medical image segmentation

General covid

General ensemble learning

General sklearn

General speech processing

General space biology

General wildlife

General data

General data analysis

General history

General fisheries

General flask

General museum

General green aviation

General workload analysis

General detection

General precipitation

General space weather

Data Domain reinforcement learning

General turbulence

General mining

General culture

General virus

General autism spectrum disorder

General cmip5

General datacenter

General japanese

General high-throughput imaging

Task active learning

General pharmaceutical

General sqlite

General seafloor

Task face recognition

General automatic speech recognition

General protein folding

General whole exome sequencing

General marine mammals

General recombination maps

General emotion

General 1950 census

General timho

General speaker identification

General computational fluid dynamics

General alphafold

General near-surface specific humidity

General vep

General data assimilation

General malware

General molecular dynamics

Task question answering

General cover song identification

Task recommendation systems

General live song identification

General art

General csi

General keras

General structural variation

Task activity recognition

General pediatric

General microbiome

General near-surface air temperature

General industrial

General national archives catalog

General cmip6

General prediction

General geothermal

General scholarly communication

General media

General simulations

General hiring

General radiation

General bitcoin

General cultural preservation

General protein template

General histopathology

General privacy

General enzyme

General science

General netcdf

General organelle

Task audio classification

General mixed file dataset

General ransomware

General tertiary analysis

General geophysics

General marine

General openfold

General loftee

General hydrography

General pandas

General msa

General variant annotation

General low-pressure turbine

General cram

General meta learning

General music features dataset

General hpc

General cell painting

General benchmark

General datascience

General structural biology

General foldingathome

General tiles

General fewshot

General ukraine

General alchemical free energy calculations

General acoustics

General xml

General coco

General gans

General huggingface

General end to end

General ai voice clone app

Task named entity recognition

General analysis

General price prediction

General eda

General snowflake

General x-ray

Task depth estimation

General python library

Framework pycaret

General text

General sports

General hebrew

General mnist

General data pipelines

General generative ai

Task object classification

General price

Task sequence-to-sequence language modeling

Task explainable artificial intelligence

General monitoring

General ai personal assistant

General matplotlib

General credit card

General autoencoder

Task text summarization

General pipeline

General disease

General wine

General linear regression

Task video object segmentation

General vector embedding database

Task object detection in aerial images

General gradient boosting

General chest cancer predition

General aiops

Task image generation

Task food recognition

General bias

Task classification with binary neural network

Task minecraft

General julia

General cml

Task music generation

General heroku

General labelling

Task image captioning

General social good

General example

General llama2

General fire

General colab

General mlops zoomcamp

Task zero-shot object detection

General gender debiasing

General ai mlops

Task 3d human pose estimation

Task automl

General evidently

General modular coding

General medical classification

General jupyter notebook

General python pakage

General master

General vector embeddings

General credit card defaulter prediction

General database

General docker

General medical terminology

General machine

General chest x-ray

General web

General data mining

General api

General banking

General vector database

General codepeak

General catboost

General bento ml

Task text matching

General transactional data

General npc

Task reading comprehension

General ai planning

General customer churn

General customer sentiment analysis

General continuous integration

General zomato

Integration bitbucket

General elasticnet

Task text-to-speech synthesis

General quantitative

General medical image classification

General aws

General ai voice assistant

General java

General loan application

General ml deployment

General noaa cors network - ncn

General image

Task pedestrian detection

General numeric arrays

General convolutional neural network

Framework ultralytics yolo

Task federated learning

General bot

General numpy

General news

General instruction following

General malaria

General unet

General fastai

Task time series

General mri

General mammography

General annotations

General spider

Task real-time object detection

General dagshub as a my favourite data science tool

General chatgpt plugins

General nltk

General toy

General version control

General its

General weather impacts

General fitnes

General gru

Task meta-learning

General script

General epu index

General notebook

General naive bayes

General pytest

General giskard

General seaborn

General ditmodel

General interpretability

General seaborg

General data version control

General emoji

General radiometric data

General paper

General cognitive control

General evaluation

Task clustering algorithms evaluation

General assistant

General swiggy

General alguae

Task object recognition

General scw

Task time series analysis

General optical coherence tomography

General nextjs

Task gesture recognition

General bug localization

General credit card default prediction

General bark

General individuals

General sea

Task face sketch synthesis

General siamese network

General fastapi

Task scientific document summarization

Task transfer learning

General devices

General development

General ner

General the blogger

General chexnet

General number recognition

Task object skeleton detection

General man naked on ice

Task license plate recognition

General tinyml

Task text-image retrieval

General scientific documents

General understanding

General chest disease

General ai voice cloning

General disease classification

General short

General xyz analysis

General vessel segmentation

General pytorch2

General unit testing

General notes

General bark voice clone

General datellite imagery

General titanic

General obesity

General cell segmentation

General telecom

General engineer

General awesome list

General mongodb

General illegal deforestation

Task data augmentation

General vsdvsdvsdvssf

General finite element method

General histological segmentation

Task object counting

General cracks and potholes

General 2022 data science related notes

Task face identification

General portfolio

General minecraft circle generator

General http traffic data

Task dimensionality reduction

Task face reenactment

General semantic search

General project

General shopping

General trial

General oracle

General bug

General books

Task rgb-d salient object detection

Task domain generalization

General visualization

General asv

Task colorization

General academic

Task news classification

General fdffwfwf

General forest

General seo

General forecasting

General lora

General baseline

General coronary plaque analysis

General smiles

General kyc

General face shape classification for improving styling

General reviewer recommendation

General movie

General car service

General digital marketing

General liberia

General insurance

Task answer selection

General singapore

General documents

General flood prediction

General 2023 data science collection repo

General product webscraping on food systesms

General accidents

General art generation

General naive-bayes

General game

General vscode

General skeleton

Task network embedding

General credit card risk

General pil

General fashion images

General edema

General dynamic time warpping

General seagrass

General exercise videos

General video-object-segmentatino

Framework jax

General torchdata

General sdw

General lstm

General hyperspectral imaging

General image complexity

General tim ho

Task fine-grained image classification

General hello-world

General runners

Task link prediction

General ecr

General production optimization

General fdfwsf

General first

Task table detection

General sometopic

General challenge

General apple

General designing

General malware detection

Task covid- diagnosis

General agents

General suicide rates analysis

Task 3d pose estimation

General happy

General mode

General instruct chatgpt

General bark voice cloning

General trip

General wdl

General tiger

General moldova

General supermarket website scraping

General discord

General latent diffusion models

Task visual question answering

General credit finance fraud

General cps

General beginner

General chatgpt

General data streaming

Task style transfer

General jitter click test

General spam-classifier

General tarantula

General olympics

General extract mfccs

General gemini

Task machine reading comprehension

General dataframe

General precious stones

General wav

General minecraft shapes

General kagle

General churn

General webapps

General man is nervous

General azure

General tasks

General manipu

General africa

General albumentations

General computing

General stroke prediction

General document image

General text-to-video

Task word embeddings

General violence detection

Task audio source separation

General best pune escorts

General heart valve prosthesis

General shap

General argument

General alpaca

General clot

General covid19 vaccine

General msr

Integration jenkins

General triplet loss

General generative design

General sad

General time prediction

General get data

General html

General cloud

General quack

General credit-risk

General plant

General adsadad asdsadsa -dsadsadsadasdasdasdasdasd

General ctr

General payments

General food time delivery

General parser

General lungs

Task few-shot learning

General dsd

General large language mode

Task domain adaptation

Task content-based image retrieval

General anaomaly detection

General omdena-milan chapter mirrored from github repo

General chat llama

General classifier

General ai4 sustainable agri-food

General bank

General diabetes

Task face reconstruction

General type

General discount

General dinosaurs

General recipe

General taxi fare prediction

Framework flax

General sdsd

Task biomedical information retrieval

General data review

General vaccine

General mosquito

Task face verification

General javaml

General skimage

Task sentence embeddings

General new upcoming data science projects for 2020

General inventory turnover

General eye

General representation learning

Task image-to-image translation

General optimization

General ec2

General defaulter

Task sentence classification

Task generalized zero-shot learning

General voice enabled

General duckdb

General insect

General soup

General speech

Framework langchain

Task visual tracking

General neutral

General video-object-segmentation

General object

Task neural architecture search

General language

General cybersecurity

General mouse

General soccer

Task feature engineering

General security

General default customer

General code review

General airflow

General deno

General wealth

General fraud

General remote working file system

Task pose estimation

General pune escorts services

General openai

General data extraction of deed of trust

General image to audio

Task speech enhancement

General yvual

General house

General mikrocontrollers

General gis data

General gaming

General vls

General phitoplankton

General tumo

General women

General dental

General integration

General power bi

General prevention

General scorecard

General marketing analytics

Task aesthetics quality assessment

General reels

Task autonomous driving

Task face model

Task classification with binary weight network

Task panoptic segmentation

General alzheimers

General jigsaw

General diffusion

Task natural language understanding

General query

General detection of gaps

General mlpipelines

General wordle

Task multi-label text classification

General similarity detection

General computer-aided design

General orchest

General healt

General author dwaipayan chakroborti

General random sampling

General futbol

Task brain tumor segmentation

General ggs

General man is ugli

Task face detection

General dubai

General vascular tissue engineering

General friendship

General clustering

Task network intrusion detection

Task edge detection

General gradio

Task hand gesture recognition

General tutorials

General open-cv

General action video games

General yolov8

General imporoving logistics and optimizing routing

General triathlon

Task pedestrian attribute recognition

General coding

General microcontroller

General marketing

General modern portfolio theory

General chest cancer

General minecraft blocks

General pickle

General digital pathology

General fauna

Task remote sensing image classification

General animals

Task document layout analysis

Task salient object detection

General preverified

General finance

General snails

General book

General contrastive loss

General explainable ai

Task multi-task learning

General physics

General neural search

General food

General agent

General tactical decision

General cat

General engine

General oci

General sql

General moez

Task music classification

General dialogpt bot

General search

General parkinson disease

Task open information extraction

General weights and biases

General abc analysis

General corpus

Task node clustering

Task long-tail learning

Task robust object detection

Task part-of-speech tagging

General newreposistory for to learning - how dagshub works

Task semantic correspondence

Task sketch-based image retrieval

Task imitation learning

Task weakly supervised action localization

Task audio tagging

Task cross-view image-to-image translation

Task homography estimation

Task visual place recognition

Task person search

Task deblurring

Task semi-supervised image classification

Task real-time strategy games

Task clique prediction

Task metric learning

Task semantic similarity

Task multimodal machine translation

Task hyperspectral image classification

Task document ranking

Task word sense disambiguation

Task tumor segmentation

Task motion segmentation

Task face alignment

Task semantic role labeling

Task multi-label classification

Task emotion recognition in conversation

Task vision-language navigation

Task discourse parsing

Task real-time semantic segmentation

Task open-domain question answering

Task spoken language understanding

Task image compression

Task dense pixel correspondence estimation

Task unsupervised anomaly detection

Task mathematical question answering

Task 3d absolute human pose estimation

Task visual object tracking

Task scene text detection

Task video frame interpolation

Task visual navigation

Task cross-lingual transfer

Task video super-resolution

Task knowledge graphs

Task speech separation

Task sarcasm detection

Task crowd counting

Task genre classification

Task multi-document summarization

Task semantic textual similarity

Task keyword spotting

Task video captioning

Task 3d object tracking

Task matrix completion

Task out-of-distribution detection

Task sign language translation

Task continuous control

Task action recognition

Task 3d pose estimation using rgb

Task image matting

Task multi-person pose estimation

Task cross-modal retrieval

Task multivariate time series forecasting

Task data-to-text generation

Task unsupervised facial landmark detection

Task low-light image enhancement

Task video retrieval

Task colorectal polyps characterization

Task fine-grained visual categorization

Task face swapping

Task audio generation

Task multimodal sentiment analysis

Task video recognition

Task table-to-text generation

Task scene classification

Task conditional image generation

Task region proposal

Task fact verification

Task keypoint detection

Task image/document clustering

Task atari games

Task weakly-supervised semantic segmentation

Task acoustic scene classification

Task continual learning

Task image super-resolution

Task hand segmentation

Task keyword extraction

Task text style transfer

Task 3d object detection

Task weakly-supervised named entity recognition

Task video-based person re-identification

Task video prediction

Task lesion segmentation

Task topic models

Task fact checking

Task rectification

Task multi-future trajectory prediction

Task dialogue generation

Task automated theorem proving

Task slot filling

Task activity detection

Task natural language inference

Task source code summarization

Task graph representation learning

Task scientific results extraction

Task opinion mining

Task multi-object tracking

Task synthetic-to-real translation

Task language identification

Task coreference resolution

Task chinese named entity recognition

Task lipreading

Task action unit detection

Task autonomous navigation

Task density estimation

Task sign language recognition

Integration new relic

Task stance detection

Task grammatical error correction

Task disparity estimation

Framework spacy

Task facial expression recognition

Task self-supervised learning

Task event-based vision

Task video summarization

Task bayesian inference

Task 3d pose estimation using rgbd

Task self-driving cars

Integration gitlab

Task entity linking

Task image stitching

Task cross-lingual ner

Task quantization

Task click-through rate prediction

Task transliteration

Task video reconstruction

Task music transcription

Task image inpainting

Task temporal action localization

Task constituency parsing

Task 3d action recognition

Task program repair

Task learning-to-rank

Task visual dialog

Task one-shot learning

Task drug discovery

Task conversational response selection

Task multi-class classification

Task trajectory prediction

Task latent variable models

Task question generation

Task math word problem solving

Task human detection

Task visual odometry

Task graph regression

Task entity typing

Task emotion classification

Task dictionary learning

Task stereo matching hand

Task eye tracking

Task speaker diarization

Task defect detection

Task image enhancement

Task bias detection

Task multiple instance learning

Task graph clustering

Task kg-to-text generation

Task causal inference

Task knowledge base question answering

Task scene text recognition

Task unsupervised image classification

Task outlier detection

Task semantic parsing

Task grasp contact prediction

Task scene recognition

Task action detection

Task text-to-sql

Task sentence embedding

Task 3d instance segmentation

Task entity disambiguation

Task person re-identification

Task vehicle re-identification

Task color constancy

Task nested named entity recognition

Task knowledge graph completion

Task virtual try-on

Task video understanding

Task monocular 3d object detection

Task intent detection

Task code search

Task scene segmentation

Task curriculum learning

Task paraphrase generation

Task self-supervised action recognition

Task abusive language

Task structured prediction

Task network pruning

Task goal-oriented dialog

Task vision and language navigation

Task multimodal activity recognition

Task lexical entailment

Task probabilistic deep learning

Task action recognition in videos

Task emotion recognition

Task hate speech detection

Task scene graph detection

Task graph matching

Task 3d multi-person pose estimation

Task image registration

Task image restoration

Task core set discovery

Task offline rl

Task change point detection

Task unsupervised machine translation

Task few-shot image classification

Task small data image classification

Task 3d reconstruction

Task scene text

Task online multi-object tracking

Task human action generation

Task common sense reasoning

Task lesion classification

Task code generation

Task color image denoising

Task abstractive text summarization

Task video generation

Task gaze estimation

Task imputation

Task interactive segmentation

Task scene flow estimation

Task paraphrase identification

Task retinal vessel segmentation

Task referring expression segmentation

Task whole slide images

Task face anti-spoofing

Task 3d hand pose estimation

Task multimodal unsupervised image-to-image translation

Task structure from motion

Task animal pose estimation

Task head pose estimation

Task lane detection

Task weakly supervised object detection

Task cross-lingual question answering

Task sound event detection

Task visual reasoning

Task patch matching

Task saliency prediction

Task zero-shot learning

Task image quality assessment

Task trajectory forecasting

Task automatic post-editing

Task morphological analysis

Task misinformation

Task abnormal event detection in video

Task compositional zero-shot learning

Task ssim

Task 3d shape reconstruction

Task general reinforcement learning

Task passage retrieval

Task stochastic optimization

Task saliency detection

Task action localization

Task action quality assessment

Task feature selection

Task relation classification

Task novel view synthesis

Task multi-agent reinforcement learning

Task dense video captioning

Task adversarial attack

Task video inpainting

Task 3d face animation

Task fine-grained visual recognition

Task 3d multi-object tracking

Task weather forecasting

Task egocentric activity recognition

Task 3d semantic segmentation

Task point cloud registration

Task monocular depth estimation

Task hand pose estimation

Task product recommendation

Task unsupervised domain adaptation

Task stereo matching

Task contrastive learning

Task partial domain adaptation

Task super-resolution

Task computed tomography (ct)

Task robot navigation

Task optical character recognition

Task starcraft

Task joint entity and relation extraction

Task facial landmark detection

Task 3d shape representation

Task multiple object tracking

Task graph classification

Task graph generation

Task node classification

Task single image dehazing

Task graph embedding

Task community detection

Task scene generation

Task human-object interaction detection

Task music modeling

Task fake news detection

Task video segmentation

Task video object detection

Task dialogue understanding

Task jpeg artifact correction

Task 3d object recognition

Task video classification

Task human part segmentation

Task decision making

Task chinese reading comprehension

Task simultaneous localization and mapping

Task motion prediction

Task action anticipation

Task action classification

Task handwriting generation

Task music source separation

Task optical flow estimation

Task video salient object detection

Task tokenization

Task semi-supervised video object segmentation

Task chunking

Task rgb salient object detection

Task 3d human reconstruction

Framework tf lite

Task image dehazing

Task text simplification

Task depression detection

Task depth completion

Task 3d point cloud classification

Task aspect-based sentiment analysis

Task dialogue state tracking

Task relation extraction

Task object tracking

Data Domain point cloud

Task traffic sign recognition

Task binarization

Task eeg

Task image cropping

Task action segmentation

Task action spotting

Task video description

Task intent classification

Task image clustering

Task face presentation attack detection

Task relational reasoning

Task document summarization

Task feature importance

Task deepfake detection

Task image retrieval

Task visual localization

Task object localization

Task task-oriented dialogue systems

Task incremental learning

Task scene understanding

Task robotic grasping

Task community question answering

Task document classification

Task instance segmentation

Task gaussian processes

Task unsupervised video object segmentation

Task abuse detection

Task unsupervised object segmentation

Task video semantic segmentation

Task variational inference

Task human robot interaction

Task video question answering

Integration s3 compatible storage

Task compressive sensing

Task image denoising

Task dependency parsing

Task boundary detection

Task speech synthesis

Task motion capture

Task handwriting recognition

Task skeleton based action recognition

Task motion estimation

Task event extraction

Task age estimation

Task fairness

Task adversarial defense

Integration google cloud storage

Task line segment detection

Task anomaly detection in surveillance videos

New topics will be added to the General category. Only displaying topics that weren't autoscanned from topics file

src

Add training files

3 years ago

README.md

Add training files

3 years ago

__init__.py

Bump version

3 years ago

_nbdev.py

Fix unexprted cell

3 years ago

core.py

Update readme and docs

3 years ago

downloader.py

Update training code

3 years ago

flyvec_train.py

Update training code

3 years ago

path_fixes.py

Update training code

3 years ago

tokenizer.py

Fix documentation

3 years ago

train_flyvec.py

Fix unexprted cell

3 years ago

You have to be logged in to leave a comment.

FlyVec Training

This is a wrapper around the original code that was used to train FlyVec. Originally coded to work on on the PowerPC architecture, it now supports any architecture with CUDA.

How to use

Prerequisites You need a python environment with numpy installed, a system that supports CUDA, nvcc, and g++.

Building the Source Files make

Note that you will see some warnings. This is expected.

Training python train.py path/to/encodings.npy path/to/offsets.npy -o save/checkpoints/in/this/directory

Description of Inputs

encodings.npy -- An np.int32 array representing the tokenized vocabulary-IDs of the input corpus, of shape (N,) where N is the number of tokens in the corpus
offsets.npy -- An np.uint64 array of shape (C,) where C is the number of chunks in the corpus. Each each value represents the index that starts a new chunk within encodings.npy. (Chunks can be thought of as sentences or paragraphs within the corpus; boundaries over which the sliding window does not cross.)

Description of Outputs

model_X.npy -- Stores checkpoints after every epoch within the specified output directory

See python train.py --help for more options.

Tip!

Press p or to see the previous file or, n or to see the next file