CODESIGN.BLOG

DESIGN THE WORLD

Menu
  • HOME
  • LIVE STREAMING
  • PROJECTS
  • COMMUNITY
  • EVENTS
  • TEAMWORK
  • RESEARCHERS
  • TOOLS
  • FAQ
  • ABOUT
  • CONTACT

DESIGN DEV-OPS SERVICE

AI Week TAU 2021

VE’AHAVTA PROJECT

https://codesign.blog/wp-content/uploads/2018/07/veahavta-project.mp4

VE’AHAVTA PROJECT

OUR FB GROUP

‏WHOLE WORLD OF DESIGN‏
‎‎Public‎ group‎
JOIN TO OUR GROUP
The whole world of design is a roof group that concentrates all the information on graphic design, industrial design, visual communication, interior design, fashion design, architecture, environmental design and more.

Here you will find trends in design, technological innovation, job offers, professional recommendations, training, technological aids, start-ups companies and more.
 

OUR FB GROUP

‏STARTUPS IN ISRAEL‏
‎‎Public‎ group‎
JOIN TO OUR GROUP
The group's goal is to disseminate and share vital science in all aspects of their technological ecosystem in Israel, and to help create connections between entrepreneurs, private investors and venture capital funds.

For any questions, cooperation and assistance for members of the technological community, please contact us with comments or details. Good luck everyone!
 
AI Data Science Summit 2020

COVID-19 AND AI: A VIRTUAL CONFERENCE

COVID-19 and AI: A Virtual Conference

DATABASE FOR RESEARCHERS TEAMS: FIGHT THE CORONA EPIDEMIC

Database for Researchers and Thinking Teams

NOVEL CORONAVIRUS INFORMATION CENTER

NOVEL CORONAVIRUS INFORMATION CENTER

NOVEL CORONAVIRUS COVID-19 (2019-NCOV) DATA REPOSITORY

Novel Coronavirus COVID19 Data Repository

INTERACTIVE MAPS OF CORONAVIRUS CASES IN ISRAEL

Interactive Maps of Coronavirus Cases in Israel

ON EXIT STRATEGY FROM COVID-19 LOCKDOWN

Live Webinar Exit Strategy COVID19

Cyber Week TLV 2021

Cyber Week TLV 2021

The NANO.IL.2021 Conference & Exhibition JLM

The NANO.IL.2021 Conference & Exhibition JLM

ACCV 2020

ACCV 2020

IMVC 2020

Israel Machine Vision Conference (IMVC) 2020

AIIDE 2020

AIIDE 2020

ICDES 2020

ICDES 2020

Service Design Hong Kong 2020

Service Design Hong Kong 2020
Home » Data Science » Design » Engineering » Technology » Google launches new search engine to help scientists find the datasets they need

Google launches new search engine to help scientists find the datasets they need

September 8, 2018 sherry 9 Data Science, Design, Engineering, Technology,

Dataset Search could be a scientist’s best friend

https://toolbox.google.com/datasetsearch

By James Vincent


Illustration by Alex Castro / The Verge

Google’s goal has always been to organize the world’s information, and its first target was the commercial web. Now, it wants to do the same for the scientific community with a new search engine for datasets.

The service, called Dataset Search, launches today, and will be a companion of sorts to Google Scholar, the company’s popular search engine for academic studies and reports. Institutions that publish their data online, like universities and governments, will need to include metadata tags in their webpages that describe their data, including who created it, when it was published, how it was collected, and so on. This information will then be indexed by Dataset Search and combined with input from Google’s Knowledge Graph. (That’s the name for those boxes that pop up for common searches. So if dataset X was published by CERN, some info about the institute will also be included in the results.)A SEARCH ENGINE TO UNITE THE FRAGMENTED WORLD OF ONLINE DATASETS

Speaking to The Verge, Natasha Noy, a research scientist at Google AI who helped create Dataset Search, says the aim is to unify the tens of thousands of different repositories for datasets online. “We want to make that data discoverable, but keep it where it is,” says Noy.

At the moment, dataset publication is extremely fragmented. Different scientific domains have their own preferred repositories, as do different governments and local authorities. “Scientists say, ‘I know where I need to go to find my datasets, but that’s not what I always want,’” says Noy. “Once they step out of their unique community, that’s when it gets hard.”

Noy gives the example of a climate scientist she spoke to recently who told her she’d been looking for a specific dataset on ocean temperatures for an upcoming study but couldn’t find it anywhere. She didn’t track it down until she ran into a colleague at a conference who recognized the dataset and told her where it was hosted. Only then could she continue with her work. “And this wasn’t even a particularly boutique depository,” says Noy. “The dataset was well written up in a fairly prominent place, but it was still difficult to find.”

An example search for weather records in Google Dataset Search. | Image: Google

The initial release of Dataset Search will cover the environmental and social sciences, government data, and datasets from news organizations like ProPublica. However, if the service becomes popular, the amount of data it indexes should quickly snowball as institutions and scientists scramble to make their information accessible.

This should be helped by the recent flourishing of open data initiatives around the world. “I do think in the last several years the number of repositories has exploded,” says Noy. She credits this to the increasing importance of data in scientific literature, which means journals ask authors to publish datasets, as well as “government regulations in the US and Europe and the general rise of the open data movement.”“I’M HOPEFUL THAT GOOGLE STEPPING IN WILL MAKE IT EASIER.”

Having Google involved should help make this project a success, says Jeni Tennison, CEO of the Open Data Institute (ODI). “Dataset search has always been a difficult thing to support, and I’m hopeful that Google stepping in will make it easier,” she says.

To create a decent search engine, you need to know how to build user-friendly systems and understand what people mean when they type in certain phrases, says Tennison. Google knows what it’s doing in both of those departments.

In fact, says Tennison, ideally Google will publish its own dataset on how Dataset Search gets used. Although the metadata tags the company is using to make datasets visible to its search crawlers are an open standard (meaning that any competitor, like Bing or Yandex, can use them to build their own competing service), search engines improve most quickly when a critical mass of users is there to provide data on what they’re doing.

“Simply understanding how people search is important… what kind of terms they use, how they express them,” says Tennison. “If we want to get to grips with how people search for data and make it more accessible, it would be great if Google opened up its own data on this.”

In other words: Google should publish a dataset about dataset search that would be indexed by Dataset Search. What could be more appropriate?


https://developers.google.com/search/docs/data-types/dataset
https://www.blog.google/products/search/making-it-easier-discover-datasets/

0 0 votes
Article Rating

Tags: a research scientist at Google AI, academia, academic studies, AI, applied machine learning, artificial intelligence, CERN, colleague, commercial web, create Dataset Search, data online, Data Science, Data Scientists, dataset publication, Dataset Search, datasets, datasets online, DESIGN, Developers, different repositories, engineering, environmental, Explaining of Israel, first target, focus, Google, GOOGLE LAUNCHES NEW SEARCH ENGINE TO HELP SCIENTISTS FIND THE DATASETS THEY NEED, Google Scholar, Google’s Knowledge Graph, government data, government regulations, governments, industry, industry tracks, Information, information accessible, James Vincent, leading experts, local authorities, metadata tags, Natasha Noy, new search engine for datasets, open data initiatives, Open Data Institute (ODI), open data movement, predictive applications, real world, researchers, scientific community, scientific domains, scientist, social sciences, state-of-the-art, technical presentations, TECHNOLOGY, The conference, The Summit, The Verge, tutorial

Previous: Dopamine – Research framework for fast prototyping of reinforcement learning algorithms
Next: Only Numpy: Deriving Forward Feed on Multi-Dimensional Recurrent Neural Networks (Spatial LSTM) by “Generative Image Modeling Using Spatial LSTMs”

Related posts

  • Fairness Accountability Transparency and Ethics in Computer Vision Tutorial

    CVPR 2020 • FATE in Computer Vision

    Tutorial on Fairness Accountability Transparency and Ethics in Computer VisionOverviewComputer vision has ceased to be a purely academic endeavor. From law enforcement, to border control,...
  • CVPR 2020 Learning 3D Generative Models Workshop

    CVPR 2020 • Learning 3D Generative Models Workshop

    Deep Declarative NetworksIntroductionThe past several years have seen an explosion of interest in generative modeling: unsupervised models which learn to synthesize new elements from the...

About The Author

sherry
sherry

CODESIGN.BLOG

Subscribe
Notify of
guest
guest
9 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
Roxy
Roxy
4 years ago

It’s great to read something that’s both enjoyable and provides prasmatigdc solutions.

0
Reply
Women Originals NMD Balck
Women Originals NMD Balck
4 years ago

I needed to create you the little word in order to give many thanks the moment again relating to the pleasant pointers you have featured on this page. This has been quite strangely generous with people like you in giving freely what many individuals could possibly have advertised as an e-book to make some dough for themselves, primarily considering the fact that you could possibly have tried it in case you considered necessary. The basics additionally worked to become a good way to be aware that other people have the same fervor much like my personal own to know the… Read more »

0
Reply
WMNS Adidas NMD R1 Raw Pink Vapour Pink FTWR White
WMNS Adidas NMD R1 Raw Pink Vapour Pink FTWR White
4 years ago

I simply wished to appreciate you all over again. I am not sure the things that I might have accomplished without the type of aspects discussed by you directly on my concern. It seemed to be a very intimidating crisis in my circumstances, nevertheless spending time with a new expert mode you solved that made me to weep for gladness. Extremely happy for the advice and in addition trust you find out what a powerful job that you are putting in training men and women by way of a blog. I am sure you’ve never got to know all of… Read more »

0
Reply
Adidas NMD R1 Primeknit Tri-Color NoirCore Rouge-Blanc
Adidas NMD R1 Primeknit Tri-Color NoirCore Rouge-Blanc
4 years ago

Needed to post you that very little remark just to thank you very much once again on your great techniques you’ve documented on this site. This is certainly strangely open-handed of you to present extensively what exactly most people could have offered as an electronic book in order to make some profit on their own, certainly considering the fact that you could have tried it if you decided. The things in addition served to become a easy way to recognize that many people have the same fervor similar to my personal own to see way more regarding this problem. I… Read more »

0
Reply
NMD R1 Runner PK White Red
NMD R1 Runner PK White Red
4 years ago

I wish to show some thanks to the writer for bailing me out of this particular crisis. Right after surfing through the the web and coming across techniques which were not productive, I thought my entire life was well over. Existing without the answers to the difficulties you have resolved by means of your main short article is a serious case, and the kind which could have in a wrong way damaged my entire career if I hadn’t noticed your website. Your primary understanding and kindness in dealing with all things was vital. I don’t know what I would’ve done… Read more »

0
Reply
Adidas Originals NMD_R1 Primeknit Vapour Grey FTWR White
Adidas Originals NMD_R1 Primeknit Vapour Grey FTWR White
4 years ago

My wife and i have been absolutely cheerful Peter could finish up his studies from the ideas he was given through your site. It’s not at all simplistic just to continually be making a gift of solutions which often many people may have been trying to sell. We really fully grasp we’ve got the website owner to be grateful to because of that. The specific illustrations you have made, the straightforward site menu, the friendships you can give support to engender – it is mostly spectacular, and it’s making our son in addition to us know that that content is… Read more »

0
Reply
Pharell Williams x Adidas NMD Human Race Running Shoes Blue/Black
Pharell Williams x Adidas NMD Human Race Running Shoes Blue/Black
4 years ago

Needed to post you one little observation to be able to give thanks over again for all the remarkable ideas you have featured in this case. This has been quite extremely open-handed of you to deliver easily exactly what most people would have offered as an e book to generate some money for themselves, chiefly now that you could possibly have done it in the event you decided. The points in addition served as a good way to be aware that other people have similar eagerness just like my personal own to realize a good deal more related to this… Read more »

0
Reply
Adidas NMD C1 Chukka Vintage White
Adidas NMD C1 Chukka Vintage White
4 years ago

Thank you for each of your work on this blog. Ellie delights in setting aside time for research and it is obvious why. My partner and i notice all concerning the compelling tactic you give powerful secrets on the website and therefore recommend participation from the others on this idea then our daughter is undoubtedly being taught a lot. Take advantage of the rest of the new year. You are doing a pretty cool job.

0
Reply
hermes birkin
hermes birkin
4 years ago

Thank you so much for providing individuals with such a memorable possiblity to read articles and blog posts from this web site. It is always so kind and also stuffed with amusement for me and my office friends to search your web site at the least three times per week to learn the newest guides you will have. Not to mention, I’m at all times fulfilled for the gorgeous pointers served by you. Selected 4 areas in this article are undoubtedly the most efficient we have all had.

0
Reply
wpdiscuz   wpDiscuz

ARTIFICIAL INTELLIGENCE REVOLUTION 2020

Artificial Intelligence Revolution 2020

WHY WOULD THE FIELD OF DATA SCIENCE BE THE MOST SOUGHT AFTER IN 2020?

WHY WOULD THE FIELD OF DATA SCIENCE BE THE MOST SOUGHT AFTER IN 2020?

Cyber Week TLV 2021

Cyber Week TLV 2021 Rescheduled

CVPR 2020 • LEARNING 3D GENERATIVE MODELS WORKSHOP

Learning 3D Generative Models Workshop

CVPR 2020 • FATE IN COMPUTER VISION

Fairness Accountability Transparency and Ethics in Computer Vision Tutorial

E&PDE HERNING 2020

E&PDE HERNING 2020

European Conference on Computer Vision 2020

European Conference on Computer Vision 2020

The NANO.IL.2021 Conference & Exhibition JLM

The NANO.IL.2021 Conference & Exhibition JLM

ICED 21 • DESIGN IN MOTION

ICED 21 • DESIGN IN MOTION
AI Data Science Summit 2020

Recent Comments

  • AlisonFargo on CVPR 2020 • FATE in Computer Vision
  • Ahmderomo on DeepMind’s AI can ‘imagine’ a world based on a single picture
  • Ahmderomo on The 35th Conference on UAI
  • Ahmderomo on Machine Learning Roadmap
  • Online Lenders on The Boy Robot of 1774
  • Quick Loans on Moda Ani – Hillel Band
  • Danielden on The Boy Robot of 1774
  • เลขอั้น on Design for a Vision
  • carmellapm18 on CVPR 2020 • Learning 3D Generative Models Workshop
  • filmkovasi on CVPR 2020 • FATE in Computer Vision

Archives

  • April 2021
  • December 2020
  • October 2020
  • June 2020
  • April 2020
  • March 2020
  • January 2020
  • December 2019
  • November 2019
  • October 2019
  • September 2019
  • August 2019
  • July 2019
  • June 2019
  • May 2019
  • April 2019
  • March 2019
  • February 2019
  • January 2019
  • December 2018
  • November 2018
  • October 2018
  • September 2018
  • August 2018
  • July 2018
  • June 2018
  • May 2018
  • April 2018
  • March 2018
  • February 2018
  • January 2018
  • December 2017
  • November 2017
  • October 2017
  • September 2017
  • August 2017
  • July 2017
  • June 2017
  • May 2017

TAGS

academia AI analytics analytics space applied machine learning artificial intelligence Conference Cyber Data Science Data Scientists deep learning DESIGN Developers DevOps domains Education engineering Ethics of artificial intelligence experience Explaining of Israel Fintech focus great success Healthcare ideas industry industry tracks innovation iot leading experts MACHINE LEARNING predictive applications real world Registration reinforcement learning researchers research innovations research track Retail state-of-the-art technical presentations TECHNOLOGY The conference The Summit tutorial

Copyright © 2023 | designed by share wood studios

wpDiscuz