Cortana goes IoT

Description

Found via a Channel 9 video from Ross Heise, Cortana on Windows 10 IoT Core, that shows Cortana is one step closer to her "real" self, to that AI we can carry around with us... :)

Check out the entire page with a great deal more details, information and setup steps;

Cortana on IoT

Cortana is a personal digital assistant working across all your devices to help you in your daily life. She learns about you; helps you get things done by completing tasks; interacts with you using natural language in a consistent, contextual way; and always looks out for you. Cortana has a consistent visual identity, personality, and voice.

IoT Core is an edition of Windows 10, and is optimized for small footprint and low cost IoT devices. Cortana is enabled on IoT Core in the Windows 10 Creators Update.

...

Use Cortana Function on IoT Core

This document describes how to enable and utilize Cortana on IoT Core. Makers and OEMs can now leverage the capabilities of Cortana to build even smarter, connected IoT devices.

...

Cortana on Windows 10 IoT Core Capabilities

Cortana on IoT Core offers reactive experiences in the Windows 10 Creators Update. A reactive experience occurs when the user initiates commands to cut through multiple steps to complete a task. Reactive information is provided in response to a query.

Cortana is extensible. In addition to the native skills supported by the Cortana application, developers can create their own skills to allow Cortana to do more.

  • With the Windows 10 Creators Update, the following capabilities of Cortana will be enabled on IoT Core.

    • Cortana skills sample list - Reminder, To-do list, Traffic/Restuarant, Chit Chat, Dictionary, Finance, Health,News, Reference, Show Times, Calculator, Weather, Entity look up, Events, Sports,Time zone, etc.
  • Catered to devices with small- or medium-sized screens (e.g. thermostat or refrigerator), provide a voice response with optimized visual content.

  • Leverages the audio pipeline provided in the Windows 10 operating system which supports linear microphone arrays. Audio input devices should conform to the guidance outlined in theMicrosoft Speech Platform.

  • To wake-up Cortana the user says “Hey, Cortana.” Keyword Spotting (KWS) runs locally to receive the voice input and complete the analysis. The audio is only sent to the cloud once the keyword is spotted. User consent is needed before enabling KWS. The KWS is optimized by the Windows Speech Platform and supports multiple languages and regions.

  • Will support en-US only.

Cortana Extensibility

Cortana custom skill provides the extensible capability for Cortana. The experts control the end-to-end experience, while Cortana brokers to relevant applications, websites, services and bots. Custom skills are created by developers, for example, OEM partners or ISVs.

OEMs can write a Voice Command Definition application that allows to add local commands to Cortana.

... [Click through for the entire post]



The Discussion

Add Your 2 Cents