IBM Data and AI

Welcome to the IBM Data and AI Ideas Portal for Clients!

We welcome and appreciate your feedback on IBM Data and AI Products to help make them even better than they are today!
Before you submit an idea, please perform a search first as a similar idea may have already been reported in the portal. If a related idea is not yet listed, please create a new idea and include with it a description which includes expected behavior as well as why having this feature would improve the service and how it would address your use case.
IBM Employees:
Clients:
  • Our team welcomes any feedback and suggestions you have for improving our offerings / products! This forum allows us to connect your offering / product improvement ideas with IBM product and engineering teams.

  • If you have not registered on this portal please click on the following link and register. To complete registration you will need to open the email you will receive from Aha to confirm your identity. http://ibm.biz/IBM-Data-and-AI-Portal-Register

Additional Information:
  • The shorter URL for this site is: https://ibm.biz/IBM-Data-and-AI-Ideas

  • To view our roadmaps: http://ibm.biz/Data-and-AI-Roadmaps

  • Reminder: This is not the place to submit defects or support needs, please use normal support channel for these cases

  • Please do not use the Ideas Portal for reporting bugs - we ask that you report bugs or issues with the product by contacting IBM support.

Ability to apply multiple pre-annotators to the same document(s)

Situation

You can run one pre-annotator on documents only. If you run one pre-annotator, and then run a second pre-annotator, the second run will strip the annotations that were added by the first pre-annotator from the documents. Pick the pre-annotation method that best fits your use case, and use that one only.

Problem

This is huge limitation because in most production use Watson Knowledge Studio the entity will need to leverage ALL pre annotation techniques. So entity 'Person Name' is best handled by Natural Language Understanding while entity 'Appliance'  is best handled by Dictionary. The true ease of use will happen when I can set both and then pre-annotate using both Dictionary and Natural Language Understanding. 

Solution

Allow combining multiple pre-annotators of any kind (Natural Language Understanding, Dictionary, Rules, or Custom Model) to the same set of documents without wiping out previous pre-annotations or human annotations. (NOTE: Would require adjudication in case of annotation conflicts.)

Different designs possible. E.g., running multiple pre-annotators simultaneously (one run) or sequentially (one after the other).

Original description before merging with WKS-I-39

Now only 1 type of pre-annotating can be used (Dictionary, Rules or NLU). It limits the pre-annotating volume and coverage while several entities should be annotated via dictionaries and rules at the same time.
It's possible also via merging Rules and Dictionaries in some way - i.e. the ability to add terms-based and rules-based pre-annotating techniques to the given entity.

  • Avatar32.5fb70cce7410889e661286fd7f1897de Guest
  • Jan 27 2018
  • Delivered
Who would benefit from this IDEA? Faster and complete pre-annotating
  • Attach files
  • Avatar40.8f183f721a2c86cd98fddbbe6dc46ec9
    Guest commented
    26 Oct, 2018 06:34pm

    Chaining pre-annotation is essential for customers e.g. Intralinks. NLU model does not have support for phone number but it supports email. So I would like pre-annotate my docs with nlu pre-annotator and then rule based pre-annotator for phone #.

  • Avatar40.8f183f721a2c86cd98fddbbe6dc46ec9
    Guest commented
    30 Jan, 2018 04:35am

    I would like to pre-annotate my new document set with my current model plus the dictionaries, in case there are changes to the dictionaries or the previous document set was missing some terms from the dictionaries.

NOTICE TO EU RESIDENTS: per EU Data Protection Policy, if you wish to remove your personal information from the IBM ideas portal, please login to the ideas portal using your previously registered information then change your email to "anonymous@euprivacy.out" and first name to "anonymous" and last name to "anonymous". This will ensure that IBM will not send any emails to you about all idea submissions