List of Finnish Datasets for NLP Projects

 https://metatext.io/datasets-list/finnish-language

FI News Corpus

Dataset is a collection of news headlines and short summaries of text, organized by date. The news articles were published between 2012-2020.

CC100-Finnish

This dataset is one of the 100 corpora of monolingual data that was processed from the January-December 2018 Commoncrawl snapshots from the CC-Net repository. The size of this corpus is 15G.

FinChat

Dataset contains conversations with message timestamps, sender’s id, and metadata information. It contains 86 conversations with 3,630 messages, 22,210 words with the average word length of 5.6, and on the average 14 turns per each conversation.

Finnish News Corpus for Named Entity Recognition

Dataset contains 953 articles (193,742 word tokens) with 6 named entity classes: organization, location, person, product, event, and date.

Finlex

Dataset is a collection of legislative and other judicial information of Finland, which is available in Finnish and Swedish.

Fiskmö

Dataset is a parallel corpus of Finnish and Swedish Languages.

FinChat

Dataset contains conversations with message timestamps, sender’s id, and metadata information. It contains 86 conversations with 3,630 messages, 22,210 words with the average word length of 5.6, and on the average 14 turns per each conversation.

FI News Corpus

Dataset is a collection of news headlines and short summaries of text, organized by date. The news articles were published between 2012-2020.

CC100-Finnish

This dataset is one of the 100 corpora of monolingual data that was processed from the January-December 2018 Commoncrawl snapshots from the CC-Net repository. The size of this corpus is 15G.

FinChat

Dataset contains conversations with message timestamps, sender’s id, and metadata information. It contains 86 conversations with 3,630 messages, 22,210 words with the average word length of 5.6, and on the average 14 turns per each conversation.

Finnish News Corpus for Named Entity Recognition

Dataset contains 953 articles (193,742 word tokens) with 6 named entity classes: organization, location, person, product, event, and date.

Finlex

Dataset is a collection of legislative and other judicial information of Finland, which is available in Finnish and Swedish.

Fiskmö

Dataset is a parallel corpus of Finnish and Swedish Languages.

FinChat

Dataset contains conversations with message timestamps, sender’s id, and metadata information. It contains 86 conversations with 3,630 messages, 22,210 words with the average word length of 5.6, and on the average 14 turns per each conversation.

pix2pix dataset

go to this page

 https://people.eecs.berkeley.edu/~tinghuiz/projects/pix2pix/datasets/

or click this link directly

	cityscapes.tar.gz	2016-12-02 23:15	99M
	edges2handbags.tar.gz	2016-12-02 23:16	8.0G
	edges2shoes.tar.gz	2016-12-02 23:17	2.0G
	facades.tar.gz	2016-12-02 23:17	29M
	maps.tar.gz	2016-12-02 23:17	239M

RecSys Challenge 2015 dataset

The goal:
Given a sequence of click events performed by some user during a typical session in an e-commerce website, the goal is to predict whether the user is going to buy something or not, and if he is buying, what would be the items he is going to buy. The task could therefore be divided into two sub goals:

1. Is the user going to buy items in this session? Yes|No
2. If yes, what are the items that are going to be bought?

Website:
https://2015.recsyschallenge.com/challenge.html

dataset link:
https://s3-eu-west-1.amazonaws.com/yc-rdata/yoochoose-data.7z

Network(GML format graph) Dataset

Best interesting data is football network

refer to this page: http://www-personal.umich.edu/~mejn/netdata/

Naver sentiment movie corpus v1.0 (korean)

https://github.com/e9t/nsmc

GAN, image segmentation dataset

dataset	example
python tools/download-dataset.py facades  400 images from CMP Facades dataset. (31MB)  Pre-trained: BtoA
python tools/download-dataset.py cityscapes  2975 images from the Cityscapes training set. (113M)  Pre-trained: AtoB BtoA
python tools/download-dataset.py maps  1096 training images scraped from Google Maps (246M)  Pre-trained: AtoB BtoA
python tools/download-dataset.py edges2shoes  50k training images from UT Zappos50K dataset. Edges are computed by HED edge detector + post-processing. (2.2GB)  Pre-trained: AtoB
python tools/download-dataset.py edges2handbags  137K Amazon Handbag images from iGAN project. Edges are computed by HED edge detector + post-processing. (8.6GB)  Pre-trained: AtoB

satellite segmentation image dataset list

• https://github.com/RSIA-LIESMARS-WHU/RSOD-Dataset-
• SpaceNet[https://spacenetchallenge.github.io/]
• https://github.com/chrieke/awesome-satellite-imagery-datasets

image segmentation dataset list

• Stanford Background Dataset
• Sift Flow Dataset
• Barcelona Dataset
• Microsoft COCO dataset
• MSRC Dataset
• LITS Liver Tumor Segmentation Dataset
• KITTI
• Pascal Context
• Data from Games dataset
• Human parsing dataset
• Mapillary Vistas Dataset
• Microsoft AirSim
• MIT Scene Parsing Benchmark
• COCO 2017 Stuff Segmentation Challenge
• ADE20K Dataset
• INRIA Annotations for Graz-02
• Daimler dataset
• ISBI Challenge: Segmentation of neuronal structures in EM stacks
• INRIA Annotations for Graz-02 (IG02)
• Pratheepan Dataset
• Clothing Co-Parsing (CCP) Dataset
• Inria Aerial Image
• ApolloScape
• UrbanMapper3D
• RoadDetector
• Cityscapes
• CamVid
• Inria Aerial Image Labeling

Image Segmentation Keras : Implementation of Segnet, FCN, UNet, PSPNet and other models in Keras.

image segmentation dataset
github : https://github.com/divamgupta/image-segmentation-keras
google drive : https://drive.google.com/uc?id=0B0d9ZiqAgFkiOHR1NTJhWVJMNEU&export=download

COVID-CT

CT images with clinical findings of COVID-19

The COVID-CT-Dataset has 275 CT images containing clinical findings of COVID-19. The images are collected from medRxiv and bioRxiv papers about COVID-19. CTs containing COVID-19 abnormalities are selected by reading the figure captions in the papers. All copyrights of the data belong to medRxiv and bioRxiv.

🏡 GitHub : https://www.visualdata.io/?fbclid=IwAR2fwIhpd27Fvk7uVQ4FVroV52Fmy7u2m-7hcAT1-7TdWa1-6PmWe-NIXaM

Covid19 Challenge Dataset

Open research on large Covid-19 imaging datasets

Medical imaging is potentially well suited for Covid-19 diagnosis. This challenge is about connecting the best brains to support doctors with artificial intelligence systems.

🏡 : https://www.covid19challenge.eu

An Open Pan-Cancer Histology Dataset for Nuclei Instance Segmentation and Classification

Semi automatically generated nuclei instance segmentation and classification dataset with exhaustive nuclei labels across 19 different tissue types. The dataset consists of 481 visual fields, of which 312 are randomly sampled from more than 20K whole slide images at different magnifications, from multiple data sources. In total the dataset contains 205,343 labeled nuclei, each with an instance segmentation mask. Models trained on pannuke can aid in whole slide image tissue type segmentation, and generalise to new tissues. PanNuke demonstrates one of the first succesfully semi-automatically generated datasets.

🏡: https://jgamper.github.io/PanNukeDataset/

The ORNL Overhead Vehicle Dataset (OOVD)

This data set was created to understand the potential for machine learning, computer vision, and HPC to improve the energy efficiency aspects of traffic control by leveraging GRIDSMART traffic cameras as sensors for adaptive traffic control, with a sensitivity to the fuel consumption characteristics of the traffic in the camera’s visual field. GRIDSMART cameras—an existing, fielded commercial product—sense the presence of vehicles at intersections and replace more conventional sensors (such as inductive loops) to issue calls to traffic control. These cameras, which have horizon-to-horizon view, offer the potential for an improved view of the traffic environment which can be used to generate better control algorithms.

link : https://www.ornl.gov/project/ornl-overhead-vehicle-dataset-oovd

3d fashion dataset

Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Images

We present Deep Fashion3D, a large-scale repository of 3D clothing models reconstructed from real garments. It contains over 2000 3D garment models, spanning 10 different cloth categories. Each model is richly labeld with groundtruth point cloud, multi-view real images, 3D body pose and a novel annotation named feature lines. With Deep Fashion3D, inferring the garment geometry from a single image becomes possible.

official :

https://kv2000.github.io/2020/03/25/deepFashion3DRevisited/

A Multi-view Multi-source Benchmark for Drone-based Geo-localization

github:

https://github.com/layumi/University1652-Baseline

MoVi: A Large Multipurpose Motion and Video Dataset

https://www.biomotionlab.ca/movi/

SPARE3D

A Dataset for SPAtial REasoning on Three-View Line Drawings

official site:

https://ai4ce.github.io/SPARE3D/

github:

https://github.com/ai4ce/SPARE3D

COVIDx

COVID-Net Open Source Initiative

https://github.com/lindawangg/COVID-Net

Dataset Finders

Dataset Finders

• Google Dataset SearchIntroductory blog post
• Kaggle Datasets Page: A data science site that contains a variety of externally contributed interesting datasets. You can find all kinds of niche datasets in its master list, from ramen ratings to basketball data to and even Seattle pet licenses.
• UCI Machine Learning Repository: One of the oldest sources of datasets on the web, and a great first stop when looking for interesting datasets. Although the data sets are user-contributed, and thus have varying levels of cleanliness, the vast majority are clean. You can download data directly from the UCI Machine Learning repository, without registration.
• VisualData: Discover computer vision datasets by category, it allows searchable queries.

Government & Statistics Data

Government & Statistics Data

• Data.gov: This site makes it possible to download data from multiple US government agencies. Data can range from government budgets to school performance scores. Be warned though: much of the data requires additional research.
• Data USA: The most comprehensive visualization of US public data
• Food Environment Atlas: Contains data on how local food choices affect diet in the US.
• School system finances: A survey of the finances of school systems in the US.
• The US National Center for Education Statistics: Data on educational institutions and education demographics from the US and around the world.
• The UK Data Service: The UK’s largest collection of social, economic and population data.
• EU Gender statistics database
• The Netherlands’ National Georegister (Dutch)
• United Nations Development Programme Projects