IBM Data & AI

 Welcome to the IBM Data & AI Ideas Portal for Clients! 

We welcome and appreciate your feedback on IBM Data & AI Products to help make them even better than they are today!
Before you submit an idea, please perform a search first as a similar idea may have already been reported in the portal.  If a related idea is not yet listed, please create a new idea and include with it a description which includes expected behavior as well as why having this feature would improve the service and how it would address your use case.
IBM Employees:
  • Our team welcomes any feedback  and suggestions you have for improving our offerings / products!  This forum allows us to connect your offering / product improvement ideas with IBM product and engineering teams.
  • If you have not registered on this portal please click on the following link and register.  To complete registration you will need to open the email you will receive from Aha to confirm your identity.
Additional Information:
  • The shorter URL for this site is:
  • To view our roadmaps:
  • Reminder: This is not the place to submit defects or support needs, please use normal support channel for these cases
  • Please do not use the Ideas Portal for reporting bugs - we ask that you report bugs or issues with the product by contacting IBM support.

Map dictionaries to subtypes and provide evaluation stats for subtypes

Currently, only being able to map dictionaries to entity types makes bootstrapping projects with subtypes very difficult. It also eliminates a major way to improve recall. Additionally, not being able to see stats at the subtype level makes it almost impossible to manage projects with subtypes.

  • Guest
  • Sep 8 2017
  • Planned
Why is it useful?

Improves the value and applicability of dictionary-based pre-annotators.

Who would benefit from this IDEA? As a Watson Developer specializing in WKS I would like a way to map dictionaires to subtypes and see their stats
How should it work?

Entity sub-types should allow association with dictionaries, the same way as top-level entity types do.

Entity-subtypes should be included in the model statistics (model evaluation) the same way as top-level entity types do.

Idea Priority High
Priority Justification
Customer Name
Submitting Organization
Submitter Tags
  • Attach files
    October 04, 2017 18:41

    I think that "see stats at the subtype level" is an important idea by itself. I will open it if you don't mind.

  • Andrei Kamarouski commented
    November 16, 2017 18:56


    March 16, 2018 00:40

    Have just been on a project using WKS and found that the automatic annotation based on a dictionary was very efective, but it still meant that the users had to click on every pre-annotated entity and select the appropriate subtype.


    I'd be wanting each dictionary entry to have an optional entity subtype be able to be recorded against it.

NOTICE TO EU RESIDENTS: per EU Data Protection Policy, if you wish to remove your personal information from the IBM ideas portal, please login to the ideas portal using your previously registered information then change your email to "anonymous@euprivacy.out" and first name to "anonymous" and last name to "anonymous". This will ensure that IBM will not send any emails to you about all idea submissions