Machine Learning
User-friendly and efficient image processing
There is no doubt that artificial intelligence offers enormous potential. However, many companies in the machine vision sector lack the necessary expertise and time to get to grips with the subject in depth. However, there are already AI platforms with user-friendly software that can help overcome implementation issues.
Industrial cameras are already being used in a wide range of industries: from equipment, plant and mechanical engineering to medical technology, agriculture and logistics. AI is opening up completely new fields of application, particularly in the area of machine vision. For example, AI-based systems enable the recognition and processing of objects with natural variance, such as food, plants or other organic objects that cannot be covered by conventional image processing. Color, surface, size, weight or shape can vary greatly. However, AI can be trained with the corresponding training data in such a way that a broad spectrum can be reliably recognized, categorized and thus also processed. The development of AI solutions with machine learning (ML) relies on a more flexible approach without rigid rules. Instead of manually developing a program code, the AI in machine learning undergoes a learning process in which it identifies important features itself using suitable image data and relates them to the annotations provided. However, the selection of this data harbors a high potential for error. In practice, the AI is sometimes provided with images with unimportant content, poor lighting, blurring or even incorrect labels, which can greatly distort the recognition accuracy of the desired features.
The key skills for working with ML methods are therefore not the same as for rule-based image processing - and the provision of hardware alone is not enough. The AI must be tested, validated, retrained and finally integrated into the application in order to guarantee a productive workflow.
The right tool for every task
System programmers are not necessarily needed to train AI-based vision systems. IDS, for example, demonstrates this with its IDS NXT platform. The idea behind it: With the right, coordinated tools, any user group can fully exploit the potential of AI vision without having to invest a lot of time and money in building up new core skills. Specialist knowledge for training neural networks and programming your own applications can be packaged in the tools for many simple AI workflows. This allows each user to implement their individual requirements without having to set up their own team of specialists. The software provides each user group with the right tools for their respective tasks and working methods.
The majority of common image processing applications work with relatively simple processes. Capture image, analyze image, make process decisions, initiate action - basic functionalities that differ in just a few details and therefore do not need to be reprogrammed each time. However, the selection of a deep learning (DL) use case, such as "classification" or "object detection", is often already too abstract as an entry point for a project to be able to derive the further action steps required for data acquisition and vision app configuration.
IDS is therefore taking the path of making AI vision with IDS NXT inference cameras accessible and easy to use for the masses. To this end, the cloud-based training platform for artificial neural networks (ANN) IDS NXT lighthouse is being expanded to include an application assistant that supports projects such as "counting objects" or "checking inspection points". The assistant selects the app basis for the appropriate use case and suggests further actions to the user. It also provides useful tips, videos and instructions. This type of guided application creation is more reminiscent of a tutorial than classic app development. At the end, a fully customized vision app is available for download, which the user only needs to activate and start on an IDS NXT camera.
A construction kit for programming
IDS also offers the option of visual programming using a modular system to create your own complex processes. A decisive advantage of these puzzled apps is their highly dynamic use and maintenance. An application created in IDS NXT Lighthouse can be further programmed interactively at any time - directly in the camera. Even new vision apps can be designed directly there. This makes this visual app editor the ideal tool from the test and trial phase through to operational use.
Inference cameras with AI accelerators show how efficiently AI can already be used. On the way to widespread use, manufacturers in particular are required to support users with user-friendly software and integrated processes. Compared to the tried-and-tested processes that have built up a loyal customer base over the years, there is still a lot of catching up to do for AI. Work is continuing on standards and certifications to increase the acceptance and explainability of the new technology. In order not to miss the boat, everyone should familiarize themselves with it. An embedded AI system such as IDS NXT helps with this, as it can be operated quickly and easily by any user group with user-friendly software tools - even without in-depth knowledge of machine learning, image processing or application programming.
Heiko Seitz, Technical Editor, IDS Imaging Development Systems










