In addition to providing previews of its upcoming iOS 13, macOS Catalina, watchOS 6, and other platforms, Apple announced the new ARKit 3 and RealityKit software frameworks for developers.
These frameworks are intended to help the programmers build great AR experiences. The business also unveiled a brand new app called Reality Composer for iOS, iPadOS, and Mac, which will allow developers produce and prototype AR encounters right on the apparatus where they’re going to appear. Additionally, Apple is bringing HomeKit to safety routers and cameras.
According to Apple, ARKit 3 puts people at the centre of AR using its new Motion Capture and Individuals Occlusion features. Together with Motion Capture, the developers will be able to incorporate people’s movements right in their apps. It will able to monitor people’s limbs, heads, and torsos in real-time. People Occlusion will be sure AR content shows up obviously in front or behind people.
Additionally, ARKit 3 adds help to monitor up to 3 people with front camera in addition to simultaneous access to both front and rear camera. Live collaborative sessions are also currently available, allowing people to use a shared AR world map.
RealityKit is your company’s new framework for producing photorealistic AR experiences. It will allow the developers readily combine virtual objects with real world environments.
“RealityKit was built from the ground up for AR,” Apple said in a statement. “It comes with a photorealistic rendering, in addition to incredible environment mapping and service for camera effects such as sound and motion blur, making virtual content nearly indistinguishable from reality.”
Developers are able to make use of RealityKit capabilities with the new RealityKit Swift API.
RealityKit Composer, on the other hand, is a program that lets developers build interactive scenes with full AR support.
“With a simple drag-and-drop interface plus a library of high quality 3D objects and animations, Reality Composer lets developers set, move and rotate AR objects to assemble an AR encounter, which is directly incorporated into an app in Xcode or exported to AR Quick Look,” Apple describes.
As part of Apple’s increased push for users’ privacy, HomeKit Secure Video enables security cameras to process and analyse video directly on user’s apparatus rather than sending it to cloud. It will then encrypt the video and save it on consumer’s iCloud account. Apple will keep 10 days’ worth of video about iCloud account and it won’t count towards storage limitations. Apple also revealed that the first cameras with HomeKit Secure Video will soon be coming from Logitech, Eufy, and Netatmo.
HomeKit can also be coming into routers, and it’ll produce a virtual firewall between your entire network and the devices on the network, thus maintaining the system as well as secure even when one of the devices is breached. LinkSys and Eero will launch the first HomeKit-enabled routers.