General: aws-pds open-data-registry natural language processing Type: dataset Task: machine translation Integration: git aws s3

Topics

Type dataset

General open-data-registry

Integration aws s3

General aws-pds

General sustainability

General agriculture

General earth observation

General geospatial

General life sciences

General machine learning

General climate

Data Domain computer vision

General genomic

General weather

General satellite imagery

General meteorological

General biology

Type model

General genetic

General environmental

Task disaster response

General deep learning

General bioinformatics

General hacktoberfest

Data Domain audio

General natural resource

Task classification

General imaging

Data Domain nlp

General natural language processing

General cancer

General mlops

Integration mlflow

General image processing

General health

General hacktoberfest 2023

Data Domain tabular

General oceans

General python

Task image classification

Integration dvc

General mapping

General coastal

General whole genome sequencing

General data science

Framework tensorflow

General biodiversity

General atmosphere

General covid-19

General elevation

General cog

General strides

General neuroscience

General global

General lidar

General open source software

Integration git

General neuroimaging

General coronavirus

General cities

General ecosystems

Framework pytorch

General water

General climate model

General csv

General aerial imagery

General neurobiology

Task object detection

General land

General air quality

General astronomy

General machine learning project

General archives

General urban

General transcriptomics

General data science project

General analytics

General food security

General parquet

General energy

General internet

General bam

General continuously operating reference station - cors

General gps

Framework scikit-learn

General homo sapiens

General conservation

General tutorial

General cell biology

General fastq

Data Domain 3d model

General stac

General encyclopedic

General cell imaging

General medicine

General broadcast ephemeris

General gnss

General gene expression

General nara

General census

General earthquakes

General json

General robotics

General infrastructure

General chemistry

General cyber security

General solar

General biotech blueprint

General magnetic resonance imaging

General statistics

General signal processing

General demography

General labeled

General mlflow-serving

General cnn

Data Domain medical imaging

General protein

General reference index

General molecule

General ice

Task autonomous vehicles

Task machine translation

General vcf

Task vision

General llm

General neural network

General mus musculus

General transportation

General multimedia

General geoscience

Task information retrieval

General chemical biology

General neurophysiology

General 1940 census

General video

General financial markets

General genetic maps

General regulatory

General osm

General population genetics

General biomolecular modeling

General floods

General microscopy

General computer security

General electron microscopy

General population

General planetary

General marine navigation

General fasta

Task anomaly detection

General streamlit

General deeplearning

General ml pipelines

Task time series forecasting

General data visualization

General artificial-intelligence

General reproducibility-challenge

Task chatbot

General medical

Integration arxiv

General wine quality prediction

General civic

General dagshub

General xgboost

General data analytics

General digital preservation

General market data

Task semantic segmentation

General genelab

General predictive analysis

Task text generation

Task denoising

General smd ai

General government records

General nifti

Integration label studio

General amino acid

General random forests

General metagenomics

General traffic

General blockchain

General us-dc

General broadband

General short read sequencing

General molecular docking

Integration github

General fluorescence imaging

General demographics

General genome wide association study

General computer forensics

General copyright monitoring

General regression

General commerce

General sars

General survey

General metadata

General bathymetry

General long read sequencing

General seismology

General fast5

General epigenomics

General digital forensics

General mers

General transformers

General healthcare

Task text classification

General kaggle

Task language modelling

General text analysis

General llms

General rag

Task sentiment analysis

General segmentation

General economics

General data cleaning

General projects

General research

General electrophysiology

General kidney

General music

Framework huggingface transformers

General datamanipulation

General network traffic

General events

General github actions

General movies

General intrusion detection

General data

General speech processing

General deployment

General predictive modelling

General x-ray tomography

General ensemble learning

General complaints

General education

General trading

General cars

Task music information retrieval

General mining software repositories

General wildlife

General sklearn

General cloud computing

Task speech recognition

General source code

Data Domain graph

General free software

Task medical image segmentation

General test

General txt

Task text-to-image generation

General covid

General space biology

General forecast

General data analysis

General detection

General industrial

General workload analysis

General simulations

General near-surface air temperature

General csi

General music features dataset

General netcdf

General timho

General alphafold

General msa

General openfold

General ransomware

General science

Task recommendation systems

General organelle

General museum

General alchemical free energy calculations

General national archives catalog

General datacenter

General enzyme

General marine

General flask

General protein template

Task active learning

General hydrography

General high-throughput imaging

General prediction

General pandas

General cultural preservation

General xml

General computational fluid dynamics

General cmip6

General history

General variant annotation

General geothermal

General whole exome sequencing

General speaker identification

General fewshot

General sqlite

General precipitation

General tiles

Data Domain reinforcement learning

General ai personal assistant

General foldingathome

General pediatric

General bitcoin

General finance

General privacy

General recombination maps

General structural biology

General keras

General mining

General datascience

General fisheries

General autism spectrum disorder

General cram

General cell painting

General hpc

General structural variation

General space weather

General radiation

General low-pressure turbine

General media

General emotion

Task audio classification

General geophysics

General marine mammals

General culture

General ukraine

Task activity recognition

General cover song identification

General vep

Task question answering

General histopathology

General 1950 census

General art

General seafloor

General microbiome

General near-surface specific humidity

General green aviation

General acoustics

General mixed file dataset

General live song identification

General molecular dynamics

General tertiary analysis

General loftee

General protein folding

General japanese

General turbulence

General automatic speech recognition

General hiring

General virus

General malware

Task face recognition

General meta learning

General benchmark

General pharmaceutical

General data assimilation

General cmip5

General scholarly communication

General autoencoder

General end to end

Task image generation

General image

General x-ray

General hebrew

General price prediction

General elasticnet

Task depth estimation

Framework pycaret

General analysis

General ai mlops

General data pipelines

General monitoring

General price

General wine

Task explainable artificial intelligence

General matplotlib

General pipeline

General eda

General huggingface

Task object classification

General gans

General sports

General ai planning

General ai voice clone app

Task named entity recognition

General aws

Task image captioning

General mnist

Task sequence-to-sequence language modeling

General disease

General python library

General text

General generative ai

Task text summarization

General linear regression

General coco

General credit card

General snowflake

General cml

General chatgpt plugins

General chapter 1

General database

General dagshub as a my favourite data science tool

General mammography

General banking

General convolutional neural network

General ml deployment

General catboost

General continuous integration

Task minecraft

General evidently

Task automl

General medical image classification

Integration bitbucket

General customer sentiment analysis

General vector embedding database

General medical classification

General transactional data

General master

General numpy

General docker

General news

General api

Task reading comprehension

General codepeak

General machine

Task time series

Task video object segmentation

General data mining

General customer churn

Task text-to-speech synthesis

Task pedestrian detection

General malaria

General chest x-ray

General heroku

General gender debiasing

General bias

General bot

General quantitative

Task text matching

General medical terminology

General modular coding

General fastai

General julia

General jupyter notebook

General python pakage

General spider

General mlops zoomcamp

Task music generation

General numeric arrays

General vector embeddings

Task 3d human pose estimation

General chat llama

General gradient boosting

General aiops

General toy

Task food recognition

General npc

Task federated learning

General loan application

General unet

General colab

Framework ultralytics yolo

General noaa cors network - ncn

General social good

General chest cancer predition

General llama2

General bento ml

General ai voice assistant

General example

General zomato

Task classification with binary neural network

General nltk

General java

General web

Task object detection in aerial images

General credit card defaulter prediction

General version control

General mri

General labelling

General instruction following

General annotations

General vector database

Task real-time object detection

General fire

Task zero-shot object detection

General happy

General geb

Task visual tracking

General neutral

General video-object-segmentation

Task data augmentation

General vsdvsdvsdvssf

General object

Task neural architecture search

General language

General cybersecurity

General finite element method

General mouse

General soccer

General histological segmentation

Task feature engineering

Task object counting

General security

General default customer

General cracks and potholes

General code review

General exp

General 2022 data science related notes

Task face identification

General airflow

General portfolio

General deno

General weather impacts

General minecraft circle generator

General wealth

General fraud

General remote working file system

General evaluation

Task pose estimation

General http traffic data

General pune escorts services

Task dimensionality reduction

General openai

General data extraction of deed of trust

General image to audio

Task face reenactment

Task speech enhancement

General semantic search

General project

General yvual

Task clustering algorithms evaluation

General house

General mikrocontrollers

General gis data

General shopping

Task learning-to-rank

General gaming

General vls

General phitoplankton

General tumo

General women

General dental

General trial

General assistant

General integration

General power bi

General prevention

General scorecard

General marketing analytics

Task drug discovery

Task aesthetics quality assessment

General reels

General swiggy

Task autonomous driving

Task face model

Task classification with binary weight network

General oracle

Task panoptic segmentation

General alzheimers

General jigsaw

General diffusion

Task natural language understanding

General query

General detection of gaps

General mlpipelines

General notebook

General wordle

Task multi-label text classification

General similarity detection

General bug

General computer-aided design

General orchest

General healt

General books

General author dwaipayan chakroborti

General random sampling

Task rgb-d salient object detection

General futbol

Task brain tumor segmentation

Task domain generalization

General ggs

General man is ugli

Task face detection

General dubai

General vascular tissue engineering

General its

General friendship

General visualization

General clustering

General asv

Task colorization

Task network intrusion detection

Task edge detection

General academic

General gradio

Task hand gesture recognition

General tutorials

General alguae

Task object recognition

General open-cv

General action video games

Task news classification

General yolov8

General scw

General imporoving logistics and optimizing routing

General triathlon

Task pedestrian attribute recognition

General coding

General microcontroller

General naive bayes

General marketing

General modern portfolio theory

General chest cancer

General minecraft blocks

General pickle

General digital pathology

General fauna

Task remote sensing image classification

General fdffwfwf

General animals

Task document layout analysis

General forest

Task salient object detection

General preverified

General seo

General snails

Task time series analysis

General pytest

General book

General forecasting

General contrastive loss

General explainable ai

General lora

Task multi-task learning

General physics

General neural search

General food

General agent

General optical coherence tomography

General tactical decision

General cat

General baseline

General engine

General oci

General sql

General coronary plaque analysis

General moez

Task music classification

General dialogpt bot

General smiles

General search

General parkinson disease

Task open information extraction

General weights and biases

General abc analysis

General kyc

General nextjs

General face shape classification for improving styling

General corpus

General reviewer recommendation

Task gesture recognition

General movie

General car service

General digital marketing

General bug localization

General credit card default prediction

General liberia

General insurance

Task answer selection

General singapore

General documents

General flood prediction

General giskard

General 2023 data science collection repo

General product webscraping on food systesms

General accidents

General art generation

General naive-bayes

General seaborn

General bark

General fitnes

General game

General vscode

General skeleton

Task network embedding

General credit card risk

General pil

General fashion images

General edema

General dynamic time warpping

General seagrass

General exercise videos

General video-object-segmentatino

Framework jax

General torchdata

General sdw

General lstm

General hyperspectral imaging

General image complexity

General individuals

General tim ho

Task fine-grained image classification

General sea

General hello-world

General runners

Task link prediction

General ditmodel

General ecr

Task face sketch synthesis

General production optimization

General fdfwsf

General siamese network

General first

General fastapi

Task scientific document summarization

Task table detection

Task transfer learning

General sometopic

General devices

General challenge

General apple

General designing

General malware detection

Task covid- diagnosis

General agents

General development

General suicide rates analysis

General ner

Task 3d pose estimation

Framework langchain

General the blogger

General mode

General instruct chatgpt

General bark voice cloning

General trip

General interpretability

General chexnet

General wdl

General tiger

General gru

General moldova

General number recognition

General supermarket website scraping

General discord

General latent diffusion models

Task visual question answering

General credit finance fraud

Task object skeleton detection

General cps

General beginner

General chatgpt

General data streaming

Task style transfer

General man naked on ice

General jitter click test

Task license plate recognition

General spam-classifier

General tarantula

General olympics

General tinyml

General extract mfccs

General gemini

Task text-image retrieval

Task machine reading comprehension

General scientific documents

General dataframe

General precious stones

General wav

General minecraft shapes

General kagle

General understanding

General churn

General webapps

Task meta-learning

General seaborg

General man is nervous

General azure

General tasks

General manipu

General africa

General albumentations

General computing

General stroke prediction

General document image

General text-to-video

Task word embeddings

General violence detection

Task audio source separation

General data version control

General best pune escorts

General chest disease

General heart valve prosthesis

General ai voice cloning

General disease classification

General shap

General argument

General short

General emoji

General xyz analysis

General vessel segmentation

General alpaca

General clot

General pytorch2

General covid19 vaccine

General msr

General unit testing

Integration jenkins

General triplet loss

General generative design

General sad

General time prediction

General get data

General html

General cloud

General quack

General credit-risk

General notes

General plant

General adsadad asdsadsa -dsadsadsadasdasdasdasdasd

General ctr

General payments

General script

General food time delivery

General parser

General lungs

Task few-shot learning

General dsd

General bark voice clone

General large language mode

Task domain adaptation

Task content-based image retrieval

General anaomaly detection

General omdena-milan chapter mirrored from github repo

General datellite imagery

General classifier

General ai4 sustainable agri-food

General bank

General diabetes

Task face reconstruction

General type

General discount

General dinosaurs

General recipe

General taxi fare prediction

General epu index

Framework flax

General sdsd

Task biomedical information retrieval

General titanic

General obesity

General data review

General cell segmentation

General radiometric data

General vaccine

General paper

General telecom

General mosquito

Task face verification

General javaml

General skimage

Task sentence embeddings

General new upcoming data science projects for 2020

General engineer

General inventory turnover

General eye

General representation learning

Task image-to-image translation

General optimization

General awesome list

General mongodb

General ec2

General defaulter

Task sentence classification

Task generalized zero-shot learning

General illegal deforestation

General voice enabled

General cognitive control

General duckdb

General insect

General soup

General speech

Task scene generation

Task object localization

Task colorectal polyps characterization

Task unsupervised object segmentation

Task sign language recognition

Task discourse parsing

Task handwriting generation

Task multiple object tracking

Task knowledge base question answering

Task 3d pose estimation using rgbd

Task source code summarization

Task 3d object detection

Task face alignment

Task skeleton based action recognition

Task image retrieval

Task semi-supervised video object segmentation

Task fake news detection

Task passage retrieval

Task image quality assessment

Task animal pose estimation

Task nested named entity recognition

Task text-to-sql

Task scene recognition

Task graph clustering

Task emotion classification

Task entity typing

Task quantization

Task facial expression recognition

Integration new relic

Task chinese named entity recognition

Task graph representation learning

Task activity detection

Task atari games

Task scene classification

Task multimodal sentiment analysis

Task face swapping

Task data-to-text generation

Task video super-resolution

Task word sense disambiguation

Task multimodal machine translation

Task weakly supervised action localization

Task imitation learning

Task sketch-based image retrieval

Task anomaly detection in surveillance videos

Task line segment detection

Task speech synthesis

Task image denoising

Task robotic grasping

Task feature importance

Task relational reasoning

Task video description

Task graph embedding

Task graph classification

Task 3d shape representation

Task robot navigation

Task super-resolution

Task partial domain adaptation

Task stereo matching

Task 3d multi-object tracking

Task saliency detection

Task ssim

Task zero-shot learning

Task head pose estimation

Task scene flow estimation

Task imputation

Task gaze estimation

Task image restoration

Task emotion recognition

Task lexical entailment

Task goal-oriented dialog

Task structured prediction

Task abusive language

Task self-supervised action recognition

Task curriculum learning

Task scene segmentation

Task code search

Task monocular 3d object detection

Task knowledge graph completion

Task color constancy

Task person re-identification

Task entity disambiguation

Task grasp contact prediction

Task semantic parsing

Task scene text recognition

Task kg-to-text generation

Task bias detection

Task defect detection

Task speaker diarization

Task eye tracking

Task stereo matching hand

Task dictionary learning

Task human detection

Task latent variable models

Task trajectory prediction

Task conversational response selection

Task visual dialog

Task program repair

Task 3d action recognition

Task constituency parsing

Task temporal action localization

Task music transcription

Task image stitching

Task bayesian inference

Task video summarization

Task event-based vision

Task self-supervised learning

Task disparity estimation

Task stance detection

Task density estimation

Task autonomous navigation

Task multi-object tracking

Task opinion mining

Task scientific results extraction

Task slot filling

Task dialogue generation

Task topic models

Task lesion segmentation

Task video prediction

Task weakly-supervised named entity recognition

Task text style transfer

Task acoustic scene classification

Task weakly-supervised semantic segmentation

Task image/document clustering

Task keypoint detection

Task conditional image generation

Task table-to-text generation

Task unsupervised facial landmark detection

Task cross-modal retrieval

Task action recognition

Task sign language translation

Task out-of-distribution detection

Task matrix completion

Task video captioning

Task keyword spotting

Task semantic textual similarity

Task crowd counting

Task sarcasm detection

Task speech separation

Task scene text detection

Task unsupervised anomaly detection

Task dense pixel correspondence estimation

Task image compression

Task open-domain question answering

Task vision-language navigation

Task semantic role labeling

Task tumor segmentation

Task document ranking

Task real-time strategy games

Task homography estimation

Task audio tagging

General newreposistory for to learning - how dagshub works

Task robust object detection

Task event extraction

Task human robot interaction

Task document classification

Task scene understanding

Task task-oriented dialogue systems

Task deepfake detection

Task document summarization

Task face presentation attack detection

Task intent classification

Task image cropping

Task binarization

Task traffic sign recognition

Data Domain point cloud

Task object tracking

Task aspect-based sentiment analysis

Task depth completion

Task depression detection

Task rgb salient object detection

Task tokenization

Task optical flow estimation

Task music source separation

Task action classification

Task action anticipation

Task decision making

Task 3d object recognition

Task jpeg artifact correction

Task video segmentation

Task music modeling

Task community detection

Task node classification

Task facial landmark detection

Task optical character recognition

Task computed tomography (ct)

Task contrastive learning

Task hand pose estimation

Task 3d semantic segmentation

Task egocentric activity recognition

Task 3d face animation

Task dense video captioning

Task novel view synthesis

Task feature selection

Task 3d shape reconstruction

Task morphological analysis

Task trajectory forecasting

Task patch matching

Task visual reasoning

Task cross-lingual question answering

Task weakly supervised object detection

Task lane detection

Task structure from motion

Task multimodal unsupervised image-to-image translation

Task referring expression segmentation

Task abstractive text summarization

Task color image denoising

Task code generation

Task online multi-object tracking

Task scene text

Task small data image classification

Task change point detection

Task hate speech detection

Task multimodal activity recognition

Task vision and language navigation

Task probabilistic deep learning

Task action recognition in videos

Task scene graph detection

Task graph matching

Task 3d multi-person pose estimation

Task image registration

Task offline rl

Task unsupervised machine translation

Task few-shot image classification

Task 3d reconstruction

Task human action generation

Task video generation

Task interactive segmentation

Task paraphrase identification

Task whole slide images

Task 3d hand pose estimation

Task misinformation

Task abnormal event detection in video

Task general reinforcement learning

Task stochastic optimization

Task action localization

Task relation classification

Task adversarial attack

Task video inpainting

Task fine-grained visual recognition

Task monocular depth estimation

Task product recommendation

Task starcraft

Task joint entity and relation extraction

Task graph generation

Task dialogue understanding

Task simultaneous localization and mapping

Task video salient object detection

Task chunking

Task 3d human reconstruction

Framework tf lite

Task text simplification

Task 3d point cloud classification

Task dialogue state tracking

Task eeg

Task action segmentation

Task image clustering

Task visual localization

Task incremental learning

Task gaussian processes

Task unsupervised video object segmentation

Task abuse detection

Task variational inference

Task video question answering

Integration s3 compatible storage

Task compressive sensing

Task dependency parsing

Task boundary detection

Task motion capture

Task motion estimation

Task age estimation

Task adversarial defense

Task node clustering

Task semantic correspondence

Task cross-view image-to-image translation

Task visual place recognition

Task person search

Task deblurring

Task semi-supervised image classification

Task metric learning

Task hyperspectral image classification

Task motion segmentation

Task emotion recognition in conversation

Task real-time semantic segmentation

Task spoken language understanding

Task mathematical question answering

Task 3d absolute human pose estimation

Task visual object tracking

Task video frame interpolation

Task visual navigation

Task knowledge graphs

Task genre classification

Task 3d object tracking

Task continuous control

Task 3d pose estimation using rgb

Task multi-person pose estimation

Task multivariate time series forecasting

Task low-light image enhancement

Task video retrieval

Task audio generation

Task video recognition

Task region proposal

Task fact verification

Task continual learning

Task image super-resolution

Task keyword extraction

Task video-based person re-identification

Task fact checking

Task multi-future trajectory prediction

Task automated theorem proving

Task natural language inference

Task language identification

Task coreference resolution

Task lipreading

Task action unit detection

Task grammatical error correction

Task self-driving cars

Integration gitlab

Task click-through rate prediction

Task image inpainting

Task one-shot learning

Task multi-class classification

Task question generation

Task graph regression

Task multiple instance learning

Task sentence embedding

Task 3d instance segmentation

Task vehicle re-identification

Task virtual try-on

Task paraphrase generation

Task network pruning

Task retinal vessel segmentation

Task sound event detection

Task automatic post-editing

Task point cloud registration

Task unsupervised domain adaptation

Task single image dehazing

Task human-object interaction detection

Task video object detection

Task video classification

Task human part segmentation

Task chinese reading comprehension

Task motion prediction

Task image dehazing

Task relation extraction

Task action spotting

Task community question answering

Task instance segmentation

Task video semantic segmentation

Task handwriting recognition

Integration google cloud storage

Task part-of-speech tagging

Task cross-lingual transfer

Task multi-document summarization

Task fine-grained visual categorization

Task hand segmentation

Task rectification

Framework spacy

Task cross-lingual ner

Task video reconstruction

Task visual odometry

Task image enhancement

Task outlier detection

Task action detection

Task intent detection

Task core set discovery

Task lesion classification

Task face anti-spoofing

Task action quality assessment

Task multi-agent reinforcement learning

Task weather forecasting

Task long-tail learning

Task clique prediction

Task semantic similarity

Task image matting

Task entity linking

Task math word problem solving

Task video understanding

Task common sense reasoning

Task compositional zero-shot learning

Task fairness

Task synthetic-to-real translation

Task transliteration

Task causal inference

Task unsupervised image classification

Task saliency prediction

Task multi-label classification

New topics will be added to the General category. Only displaying topics that weren't autoscanned from topics file

1 Branches

.gitignore

Initial commit

1 year ago

README.md

update readme automation

1 year ago

DagsHub Storage

s3://web-language-models

You have to be logged in to leave a comment.

Provision of Web-Scale Parallel Corpora for Official European Languages (ParaCrawl)

Stream data with DDA:

from dagshub.streaming import DagsHubFilesystem

fs = DagsHubFilesystem(".", repo_url="https://dagshub.com/DagsHub-Datasets/paracrawl-dataset")

fs.listdir("s3://web-language-models")

Description:

ParaCrawl is a set of large parallel corpora to/from English for all official EU languages by a broad web crawling effort. State-of-the-art methods are applied for the entire processing chain from identifying web sites with translated text all the way to collecting, cleaning and delivering parallel corpora that are ready as training data for CEF.AT and translation memories for DG Translation.

Contact:

ParaCrawl is a set of large parallel corpora to/from English for all official EU languages by a broad web crawling effort. State-of-the-art methods are applied for the entire processing chain from identifying web sites with translated text all the way to collecting, cleaning and delivering parallel corpora that are ready as training data for CEF.AT and translation memories for DG Translation.

Update Frequency:

New data is added according to ParaCrawl release schedule.

Managed By:

https://paracrawl.eu

Resources:

resource:
- Description: Parallel Corpora to/from English for all official EU languages
- ARN: arn:aws:s3:::web-language-models
- Region: us-east-1
- Type: S3 Bucket

Tags:

aws-pds, machine translation, natural language processing

Tip!

Press p or to see the previous file or, n or to see the next file