It was late autumn 1999 when products with our very first ARTPEC system-on-chip (SoC) were released. Now, building on of years of experience, knowledge, and passion for high-quality technology we are on the ninth version of the SoC. Together with Stefan Lundberg, Senior Expert Engineer, Technologies at Axis, we looked back over the twenty-plus years of our ARTPEC journey and talked about key insights and developments.
The secret behind Axis cameras
The ARTPEC SoC is a vital component of our products as it provides the basis for essential capabilities like image quality, analytics features, and coding performance. It’s the “secret” behind our many of our advanced network devices. During the design process for each subsequent generation of ARTPEC, we have had to address a recurring and crucial challenge: the tradeoff between performance and features versus cost and power consumption. Each ARTPEC generation added not only pixel throughput but also improved or new critical features. The number of transistors came close to doubling with each new ARTPEC SoC, but the size, power consumption, and cost have stayed almost the same.
A revolutionary SoC
“Our ARTPEC SoCs were a small revolution – for us and our industry. While we might not have invented the wheel, we did revolutionize the way video is transferred, adding a lot of flexibility and opportunities for novel applications. The invention of ARTPEC enabled us to develop completely new technologies, such as Axis Forensic Wide Dynamic Range (WDR), Axis Zipstream data compression technology, and powerful analytics that both run on the edge and are based on AI,” says Lundberg.
The invention of ARTPEC enabled us to develop completely new technologies
These technologies could not have been brought to market without the SoC, but it did not happen overnight. It was the result of many achievements over time that are the cornerstones of our ARTPEC journey – small turning points that slowly changed the industry. For example, ARTPEC-1 made it possible to create the first cost-efficient network camera with full video performance. With ARTPEC-3, we were able to deliver top-quality video with higher resolution than the analog video cameras of the day. ARTPEC-5 let us improve our WDR solution, which resulted in what we call Forensic Capture. Forensic Capture stood out from competitor solutions of its day by prioritizing visibility and detail over mere aesthetics. For the first time, it became possible to effectively use video cameras under difficult light conditions such as in storefronts with large glass facades in direct sunlight. The method has since become an industry standard. Another equally revolutionary innovation made possible by ARTPEC-5 was our Zipstream compression technology, which preserves forensic detail in full resolution, while significantly lowering bandwidth and storage requirements.
The first ARTPEC SoC and a new way to innovate
While there was no ARTPEC SoC in the world’s first network camera, our AXIS Neteye 200 camera, we soon realized that available off-the-shelf SoCs could not deliver the level of performance we wanted going forward. That realization kicked off development of our first ARTPEC SoC. We started working on it in late autumn 1996 and released the first ARTPEC-based product, AXIS 2100, at Comdex in November 1999.
“We didn’t know it at the time, but ARTPEC would become the core element that enabled us to expand our offering with limited resources from a few products to a complete portfolio that later would revolutionize the surveillance industry,” states Lundberg.
Of course, revolutions do not happen overnight. It was a process. Each generation of SoC addressed a new main goal and we had to constantly reinvent our way of working as complexity increased.
“One key factor that helped us get where we are today is how we tackled the innovation process. The core technologies department is organized into independent groups that all focus on problems and improvements in several fields. We gave them the freedom to explore and focus on the areas they thought would have the biggest potential in the future. The only responsibility the teams had was to deliver something for the next ARTPEC generation. Finding inspiration from other markets and approaching certain issues together solved a lot of problems in our industry,“ explains Lundberg.
Our ARTPEC cornerstones
Thanks to ARTPEC-1’s dedicated image and compression hardware we could stream video directly from the camera to a remote location using the Internet without the need for a massive amount of equipment. We simply required users to point the web browser to the embedded web server in the camera and we used standard IT protocols to transfer the video. That was revolutionary since the Internet was new and other video transfer solutions used dedicated video cables.
AXIS 2100, the first network camera using ARTPEC-1, was revolutionary too with its internal software based on a completely new embedded operating system, known today as embedded Linux. To enable fast and efficient development of a portfolio of products we chose to scrap the proprietary RTOS (Real-Time Operating System) and use μClinux, which we believed was right for Axis to grow with. In fact, AXIS 2100 was the first mass-produced product in the world that used embedded Linux. Looking back, we could not have made a better decision. Even though it required a lot of extra work to implement all kinds of now-standard elements, such as a flash-based file system, we could grow together with Linux.
ARTPEC-2, launched in 2003, made much better performance possible, and we also started experimenting with a more efficient video encoding technology called MPEG.
ARTPEC-3 was completed four years later, and it opened the door to IP-video with best-in-class throughput. For the first time, we combined the best video encoder of its time (H.264/AVC) with the rest of the system into a single SoC that could deliver high-quality HDTV resolution.
In 2011 we launched ARTPEC-4, which enabled a technology that solved two remaining issues: limited dynamic range and light sensitivity. Calling the solution Lightfinder, we released the first progressive-scan camera. It significantly outperformed the interlaced-scan analog cameras of the time. ARTPEC-4 also underpinned a new wide dynamic range (WDR) solution that worked well and was widely requested. In 2013, with the development of ARTPEC-5, we were able to further improve our WDR technology with a solution called Forensic Capture WDR.
Our sixth generation of ARTPEC was released in 2017. It added a new level of security and paved the way for the release of ARTPEC-7 two years later.
ARTPEC-7 enabled enhanced security features in Axis cameras including signed firmware and secure boot. It became the basis for improvements to all the signature Axis technologies for difficult light conditions including Axis Lightfinder 2.0 and Forensic WDR and it extended the range of IR illumination. It also facilitated a choice of the H.264 and H.265 codec and featured a real-time detection engine for object-classification analytics.
ARTPEC-8 was designed first and foremost to support powerful analytics applications based on AI. It was the basis for AXIS Object Analytics and opened the door to other analytics based on AI – including tailor-made applications from our partners.
ARTPEC-9 – the latest developments
“The best way to illustrate progress between 1999 and now is to compare the very first ARTPEC SoC and our latest SoC directly,” says Lundberg, “While the main flow of pixels between sensors and network is the same for both types, ARTPEC-1 only supported image delivery and offered no flexibility. Putting their differences in context means, ARTPEC-8 provided over 100 times the performance of the first SoC while its size and price were similar,and ARTPEC-9 continue in the same direction.”
ARTPEC-9 refines the remarkable features and capabilities that characterized previous generations of our in-house-designed SoC: low bitrate, AI-powered analytics, superior imaging, and built-in cybersecurity. It also introduces AV1, an open-source video encoding standard from the Alliance for Open Media. With support for AV1, and enhanced image processing ARTPEC-9 delivers high-quality video with uncompromised detail and clarity and best-in-class bitrate. Together with Axis Zipstream, AV1 also ensures hassle-free video both on-prem and in the cloud. In addition, ARTPEC-9 powers advanced analytics applications that detect objects earlier and analyze events more precisely.
The future of ARTPEC
“Looking at the progress we’ve made, I can say that what has evolved most over the years is image quality and the capacity for analytics, including analytics based on AI. Both have been and will continue to be game changers for the surveillance industry,” says Lundberg.
The ARTPEC SoC – and the fact that we design it in-house and control its manufacturing – is our foundation for creating innovative products that meet the needs of our customers today and in the future. It is hard to predict – or even imagine – what developments the next 20 years with ARTPEC will bring, but we are certainly excited about the potential.