Diffbot

01/27/2022

When the world's largest consumer company—Avast—was looking to develop a universal score for every site on the web, they turned to Diffbot, the experts in -scale , to help them ship the project in record time.

Check out the story of our collaboration as told by Staff Scientist at Avast Software, Galina Alperovich 👇🦾

07/09/2021

Join us for a free 45-minute live webinar on using the world's largest Knowledge Graph for demand generation.

Diffbot's Knowledge Graph is a web-sourced database of hundreds of millions of organizations, and people linked by a range of searchable fields.

Our event starts at 1:30 PT (GMT -7) Thursday July 17th. Register below!👇

https://my.demio.com/ref/LmEH4oFCy34lPBj9

07/06/2021

What does external data mean to you?

For top finance / VC / investing firms it doesn't mean missing out on the structure, scale, or accuracy of more traditional data sources.

It means the ability to extend traditional data to include market signals that obviously matter... but have previously been relegated to manual research or cumbersome scrapers.

Join us for this week's live webinar at 1:30 PST, Thursday, July 8th!
👇🦾🕸️

Register for this Upcoming Session on July 8th, 2021 at 3:30PM CDT

04/30/2021

Last week we shared a walkthrough of a custom dashboard solution that pulls in the world's largest knowledge graph, web scraping results, and natural language processing.

This week we're diving in again to highlight ways in which you can infuse your dashboard (or BI tool of your choice) with structured data from across the web.

In particular we're looking at pulling data for market intelligence, news monitoring, and lead generation from unstructured web data and into an actionable format.

Check it out in our latest whitepaper!

It took Google knowledge panels one month and twenty days to update following the inception of a new CEO at Citi, a F100 company. In Diffbot’s Knowledge Graph, a new fact was logged within the week, with zero human intervention and sourced from the public web. The CEO change at Citi was announced ...

04/27/2021

If you could fit the entire web into part of a dashboard, what would it look like?

Would it feature product details? Brand mentions? Organizations or people of interest? Sentiment? Diffbot both crawls and structures the entire web and provides a suite of tools for you to structure the corners of the web you care about.

Here's one example of a public web data-sourced dashboard that draws from our Knowledge Graph, Automatic Extraction APIs, and Natural Language API for market intelligence.

What could you do with a bot that read the web nonstop?

04/20/2021

What does it take to be in the top 1% of data teams? For starters, taking a look at your unstructured data.

An estimated 90% of total unstructured data has been created in the last two years. And it's estimated that

Natural and unstructured language is how humans largely communicate. For this reason, it’s often the format of organizations’ most detailed and meaningful feedback and market intelligence. Historically impractical to parse at scale, natural language processing has hit mainstream adoption. The gl...

04/13/2021

DQL is the gateway to an entirely new way to interface with web data. It's the internet parsed into billions of entities filled with trillions of facts. Organizations, articles, products, people, and more.

Diffbot Query Language may sound technical. But we see it used every day by non-technical users. There's even a visual query editor.

Here's one user's story of a year of using DQL for data enrichment, news monitoring, market intelligence, and just plain personal curiosity.

Diffbot Query Language Let’s You Query The Public Web Like A Database

04/09/2021

What do the following have in common? 🤔
- Founders Previously VPs/Directors at FAANG Companies
- Top Employers of Roles in Data Related Fields
- Top Investors of Video Gaming Companies
- PhD Graduates Specializing in Negotiation Strategy
- Whole Foods Retail Store Locations
- Global Mid-Market Software Companies

1️⃣ They generally aren't something you can find with search engines, but they're all represented by thousands (if not millions) of data points in our Knowledge Graph. 🕸️🔥

2️⃣ They're featured on our site redesign, where you can zoom in, zoom out, and traverse these data sets within the world's largest Knowledge Graph! 😎



https://www.diffbot.com/products/knowledge-graph/ -exploredatasets

04/08/2021

What does misinformation, climate change, and article index deduplication have in common? They were all topics of peer-reviewed studies that utilize Diffbot's Knowledge Graph. Check out some of 2020's coolest KG-enabled research here: https://blog.diffbot.com/diffbot-powered-academic-research-in-2020/

At Diffbot, our goal is to build the most accurate, comprehensive, and fresh Knowledge Graph of the public web, and Diffbot researchers advance the state-of-the-art in information extraction and natural language processing techniques. Outside of our own research, we’re proud to enable others to do...

03/26/2021

More data, more problems...

Not that fresh, cleaned, and applicable data is bad. But data has a way of quickly becoming stale, corrupted, or just being wrong in the first place.

Check out the ways in which the world's largest Knowledge Graph can plug into your data stores in this video on data enrichment!

https://www.youtube.com/watch?v=Mn2QOJtONzM

Internal datasets can easily turn stale or contain dirty data. This can lead to faulty analyses, inefficiencies in your knowledge workflow, and underutilized...

03/23/2021

Crawlbot can be used to spider through 50 pages or 50,000. But how does it process the pages it visits?

You simply tell Crawlbot which extraction API to use. And you don't have to be technical to use them.

Our Automatic Extraction APIs leverage AI and machine vision to pull relevant information from the most common crawled page types like products, discussions, and articles.

Have an uncommon page type or want a custom field extracted? Tell Crawlbot to apply a Custom API to precisely the data you're seeking.



Check out our second Crawlbot basics video below.

In this second Crawlbot basics tutorial, we look at what web data extraction APIs you can pair with Crawlbot. Crawlbot is a web spider that can quickly follo...

03/19/2021

Data's not the new oil. It's the new soil from which analytics insights CAN grow. But data can also be a liability. And data that requires large amounts of processing to clean sometimes just isn't worth the time.

In this guide we look at some of the most common difficulties organizations have with cleaning their data. And provide workarounds for each.

https://blog.diffbot.com/the-biggest-difficulties-with-data-cleaning-with-work-arounds/

Data is the new soil. David Mccandless If data is the new soil, then data cleaning is the act of tilling the field. It’s one of the least glamorous and (potentially) most time consuming portions of the data science lifecycle. And without it, you don’t have a foundation from which solid insights ...