brianrisselada's profile

70 Messages

 • 

1.6K Points

Sat, Feb 12, 2022 1:58 AM

No Status

Music videos are missing from IMDb Dataset title.basics.tsv.gz

Hello, on February 9, 2022 I downloaded the file title.basics.tsv.gz from the dataset at https://datasets.imdbws.com/

This data set is missing all of the titles in the Music Video category. Can you please fix this so that these appear in this dataset document?

Employee

 • 

14.4K Messages

 • 

281.7K Points

8 m ago

Hi brianrisselada -

Thanks for reporting the missing titles, I have alerted the appropriate technical team to investigate.  As soon as I have an update I will relay the information here.

Cheers!

70 Messages

 • 

1.6K Points

@Michelle​ Hi

Have you heard anything back about this yet?

Thanks!

70 Messages

 • 

1.6K Points

8 m ago

Thank you so much Michelle

70 Messages

 • 

1.6K Points

8 m ago

Also, I didn't check for sure but I think they may be missing from the other dataset files too like crew and ratings.

Employee

 • 

14.4K Messages

 • 

281.7K Points

Hi @brianrisselada​ -

Thanks for this additional comment, I have added this to the ticket.  I can confirm that the ticket is currently still being researched, as soon as I have an update I will be sure to post the details here.

Thanks again for your patience!

70 Messages

 • 

1.6K Points

7 m ago

Hi @Michelle , just checking in again to see if there are any more updates on this.

I appreciate it.

Employee

 • 

14.4K Messages

 • 

281.7K Points

Hi @brianrisselada​ -

The ticket is still being investigated by the applicable tech team.  As soon as I have an update on the status I will let you know here.

Thanks for your patience!

70 Messages

 • 

1.6K Points

Hi @Michelle​ 

I hope you don't mind me just checking in again to just confirm if there have been any new updates on this or time estimates for fixing.

Thanks.

Employee

 • 

14.4K Messages

 • 

281.7K Points

Hi @brianrisselada​ -

I just checked the ticket status and can see that it is still pending review by our tech team.  Unfortunately, I cannot provide a timeline as to when it will be resolved, but I have given a nudge on the ticket to see if I can help speed up the investigation.

Thanks again for your patience!

70 Messages

 • 

1.6K Points

@Michelle​ Thank you!

70 Messages

 • 

1.6K Points

@Michelle​ Just popping in again to see if you think it would be helpful to give another nudge on this ticket since it's been a couple more weeks now.

Employee

 • 

14.4K Messages

 • 

281.7K Points

Hi @brianrisselada​ -

I reviewed the ticket and unfortunately, it is still pending review.  Unfortunately I cannot provide an exact timeframe as to when it will be handled by the tech team, although I will continue to nudge the ticket for progress.

70 Messages

 • 

1.6K Points

@Michelle​ I appreciate nudging it.

It is frustrating that this data that has been freely available that we have been using has been missing a bunch of information for a while now.

(edited)

70 Messages

 • 

1.6K Points

@Michelle​ Just checking in again.

I just downloaded the latest file again and the data is still missing.

Do you know why this is taking so long or why it does not seem to be a high priority?

I like that this new category of Music Video has been created, but to provide these files but not have all of the titles showing up in them makes the files useless in many ways. And it has been like this for several months at least.

Thanks for your help.

70 Messages

 • 

1.6K Points

@Col_Needham Do you have any insight into this?

Thank you.

70 Messages

 • 

1.6K Points

@Michelle or anyone else? Is anyone reading this?

Is there any other way to easily extract this information?

70 Messages

 • 

1.6K Points

@Michelle​ Thought I'd just check in again to see if there is any movement on this.

Thanks.

70 Messages

 • 

1.6K Points

Just checking in again. Haven't heard from @Michelle in over a month so just wondering if any other employees know anything about this.

@Bethanny @Maya @Sally @Fran @Edward @Jon 

1.6K Messages

 • 

28.9K Points

@brianrisselada​ It seems we hear from IMDb staff less and less these days on this forum. I am waiting for numerous pending posts to be resolved by staff.

70 Messages

 • 

1.6K Points

@keyword_expert​ Thanks for your comment. I actually was wondering if it was just this issue that was no longer being given attention or if it was happening more in general.

70 Messages

 • 

1.6K Points

I'm not sure what else to do. I seem to have been abandoned.

I guess I'll see if there are any other ways to contact employees at IMDb other than through this board.

If anyone reading this is aware of any other ways like a phone number or email or other people who work at IMDb that might be able to help, please let me know.


Thank you.

1.6K Messages

 • 

28.9K Points

@brianrisselada​ 

I recently received this response from @Michelle on this thread:

Again, I apologize for the delay on handling these larger-scale Keyword updates.  After this coming US Holiday we are hoping to systematically handle these older requests on a more consistent basis.

70 Messages

 • 

1.6K Points

@keyword_expert​ Thank you for sharing.

70 Messages

 • 

1.6K Points

What IMDb staff is encouraging with having an incomplete dataset available here is for people to start mass scraping the site for data now. I know they don't like data scraping on their site but if they don't provide the data any other way that's about the only way available to get it.

70 Messages

 • 

1.6K Points

@Michelle​ It's been three months since I've heard from you. Can you give me a status update on this?

Thanks.

1.6K Messages

 • 

28.9K Points

7 m ago

Brian, can you clarify what you mean by "Music Video category?"

As far as Genres, there is a Music genre and a Musical genre. Are you referring to one or both of these? (There is not a Music Video genre.)

There is also a "music-video" keyword, which is currently assigned to about 83,400 titles.

https://www.imdb.com/search/keyword/?keywords=music-video

Which of these is missing from the file?

cc: @ACT_1 

___

Edit: I figured it out. You were referring to the music video title type, which largely overlaps with the "music-video" keyword.

https://www.imdb.com/search/title/?title_type=music_video

(edited)

70 Messages

 • 

1.6K Points

@keyword_expert​ Thanks for asking. Let me clarify.

The "Music Video category" I'm referring to is neither a genre category nor a keyword category.

Rather it's in the category that IMDb seems to define as a "Title Type"

For more clarification, the list of categories under Title Type is short enough to list here (you can see them in the Advanced Title Search form https://www.imdb.com/search/title/):

  • Feature Film
  • TV Movie
  • TV Series
  • TV Episode
  • TV Special
  • Mini-Series
  • Documentary
  • Video Game
  • Short Film
  • Video
  • TV Short
  • Podcast Series
  • Podcast Episode
  • Music Video

The category of "Music Video" was recently created. However many of the titles that are currently designated as this category have been in the database for a long time, but used to be designated in other categories in the past, such as "Short Film" or "Video".

The following search URL shows the titles that are missing from the file: https://www.imdb.com/search/title/?title_type=music_video

(edited)

70 Messages

 • 

1.6K Points

@keyword_expert​ Do you know anything else about this issue? I haven't heard back from anyone in a while.

1.6K Messages

 • 

28.9K Points

I don't know anything except what has been posted in this thread.

70 Messages

 • 

1.6K Points

@keyword_expert​ From your experience do many people use these dataset files? They don't seem too concerned with fixing this very quickly. I thought this was a resource that a lot of people used.

1.6K Messages

 • 

28.9K Points

@brianrisselada​ I really wouldn't know; I only learned of the existence of these files around the time you posted this thread.

Employee

 • 

14.4K Messages

 • 

281.7K Points

3 m ago

Hi @brianrisselada -

Again, my sincere apologies for the delayed response.  I understand the frustration, especially given that you reported this issue initially back in February. 

I just reviewed the open ticket and can see that it is still being researched.  As this ticket has not been prioritized, I have again inquired on the status with the applicable team, once I receive a response I will post the information here.

70 Messages

 • 

1.6K Points

@Michelle​ Apology accepted. Thank you for the response.

If I don't hear back after a certain amount of time, is it OK if I check in again? If so, what would that amount of time be?

Thank you!

1.6K Messages

 • 

28.9K Points

1 m ago

Was this issue ever resolved?

70 Messages

 • 

1.6K Points

@keyword_expert​ I just downloaded the latest file and it is still not fixed. Music videos are still not appearing in the file.