Uploaded image for project: 'Qt'
  1. Qt
  2. QTBUG-108069

Support for triggering application actions via voice commands

    XMLWordPrintable

Details

    • User Story
    • Resolution: Unresolved
    • Not Evaluated
    • None
    • None
    • Speech
    • None

    Description

      As a user of a Qt application, I want to be able to trigger specific application actions by voice command.

      This would typically be a sequence that starts with a wake-up word (like "Hey Siri" or "Alexa"), and then a natural language representation of a well-defined activity that is specific to the context of the current application or domain ("make the current paragraph bold").

      This is different from free text dictation via speech recognition, which is usually covered by the platform's input method framework.

      Open Questions

      Should an application inform the engine about what actions there are and what valid phrases it can support?

      Such a system would need to be backed by some natural language processing machinery, ie. mapping "Hey TextEdit, make the current paragraph bold" to a sequence of actions (Select current paragraph, select the "bold" action, then remove the selection). How much of that is already provided by each platform's speech recognition framework?

      • macOS
      • iOS
      • Windows
      • Android
      • Linux

      Attachments

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

        Activity

          People

            vhilshei Volker Hilsheimer
            vhilshei Volker Hilsheimer
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:

              Gerrit Reviews

                There are no open Gerrit changes