Designing Buildings - User contributions [en]

Smart glass and artificial intelligence

2022-09-05T14:27:36Z

Smartglassworld:

= Introduction =

Smart Glass is only as smart as the control system that drives it.

Whether it is for viewing the exterior world from within buildings or vehicles, or filtering incoming daylight onto interiors, smart glass systems must now evolve to a position where they are continuously learning from their environment, adapting to changes in local and global events.

For this, the future of smart glass systems must reside with artificial intelligence.

Your smartphone can adjust its behaviour based on your personal data and local events:

* dimming down the screen when the battery is low,
* detecting the risk of a heart attack using a medical app, and
* finding the best sushi restaurant, near you, right now.

Similarly, a smart glass system should also be able to adjust its behaviour based on what is happening in its local environment and what it is learning from global events as they unfold in real-time.

= Use cases =

We have seen some excellent examples in the news recently from smart glass manufacturers such as View and Halio in which proprietary artificial intelligence (AI) algorithms adapt building facades to changes in sunlight, with clear benefits for sustainability, privacy and comfort.

Let us now consider some more advanced use cases that would take this a step further:-

== Security threats in large cities ==

Just as car doors unlock automatically on detecting an accident, smart glass facades could also default to a 'safe' transparent state in emergency situations.

For example, if an AI law enforcement app monitoring social media chatter detected an imminent terrorist threat in a large city during a bright sunny day, it is probable that any building with a smart glass facade would be in its energy-filtering ‘dark mode’, to minimise glare and air conditioning costs. This dark mode however would also impair visibility into the building for law enforcement and security agencies trying to ensure everyone has been evacuated. In this case, smart glass facades in the immediate vicinity of the security threat could automatically transition to an ‘emergency mode’ in which they are held indefinitely in a transparent state.

This same principle could also be applied to smart glass systems installed in transportation, enabling a visual line of communication with passengers trapped after an accident, or when the vehicle predicts the risk of a stranded infant or pet suffering possible dehydration.

== Theft of high-value items ==

Whether in a private residence, a high-end jewellery store or an art gallery, if smart glass is being used in external windows, interior partitions or in showcases, and if the AI algorithm monitoring CCTV cameras anticipates an imminent theft, the smart glass system could ‘go dark’, obscuring the items and slowing down the attacker from finding the most valuable pieces.

When the premises are closed, security guards still need to be able to see the displayed items while on patrol. However, if the building security is likely to be breached, the sensible solution would be to hide everything from view. Not just the most valuable items, but everything.

== Reducing light damage in museums and luxury retail ==

Global art and luxury retail inventories worldwide can amount to billions of dollars in assets, but excessive light exposure can cause severe damage to paintings, rare books, fashion textiles and even fine wines. If the smart glass control system ‘knew’ which materials were on display (and their sensitivity), it could dim the glass.

This change in illuminance would be practically imperceptible to humans since the eye is an approximately logarithmic sensor (Weber–Fechner law), but it would substantially reduce the long term damage to artworks and luxury materials, since light exposure is the time-integral of the light level. i.e. we calculate light exposure by multiplying the light level by the exposure time.

Future smart glass systems should also learn to automatically identify which items are most vulnerable to damage using AI-enabled machine vision, adjust their behaviour proactively and intelligently to preserve the value of the items displayed.

= What is smart glass? =

Smart glass is not a product, but rather a family of technologies.

Broadly speaking, this family can be divided into two major groups: ‘passive’ and ‘active’. In both cases, a stimulus triggers changes in certain properties of smart glass, such as its transmittance, its reflectance, its ability to refract light (i.e. scatter light) and even its electrical conductivity.

* Passive smart glass reacts to environmental stimuli such as light or temperature. Examples include thermochromic and photochromic smart glass which dims in response to heat or ultraviolet light (respectively). This ability to dynamically reject various spectral portions of solar radiation can reduce air conditioning costs in buildings and vehicles, reduce glare for office workers and reduce damage to interior furnishings and retail inventories.
* Active smart glass on the other hand is driven electrically, triggered by manual switches, sensors or control commands from a building management system (BMS).

Examples of active smart glass technologies include:

* suspended particle devices (SPD-SmartGlass), patented by Research Frontiers Inc.
* electrophoretic smart glass technology, such as eLstar Dynamics
* liquid crystal smart glass such as Merck Eyrise or Smartglass International (note: when the liquid crystals are dispersed in a polymer film this technology is called ‘PDLC’ smart glass),
* electrochromic glass (examples include View, Halio and SageGlass) and
* micro-blinds, created by the National Research Council of Canada (NRC).

Within the smart glass family we could also reasonably include ‘transparent photovoltaic’ (TPV) glass, which converts part of the electromagnetic spectrum into electricity (albeit not as efficiently as solar cells). Examples include products from Ubiquitous Energy and Clearvue Technologies.

The advantage of TPV smart glass over solar cells is that the former is transparent to visible light, thus allowing its use as 'electricity-generating windows' in exterior building facades. When incorporated directly onto the building facade, it is often referred to as 'Building-Integrated Photovoltaics' (BIPV).

Other materials which can be classified within the ‘smart glass family’ include smart mirrors, augmented-reality spectacles (think Vuzix, RealWear, Google Glass or the much-anticipated Apple Glass) and heads-up displays (HUDs) for transportation.

= Artificial intelligence =

Artificial intelligence (AI) aims to predict future outcomes based on historical data, rather than relying on pre-programmed rules.The system is ‘trained’ to recognise patterns, behaviours or properties and, over time, learns what response to execute. Artificial intelligence is often seen as an umbrella term, encompassing machine learning, which can be specialised to deep learning and further specialised to neural networks.

Current examples of AI applications include automated stock trading, customer service chatbots, Netflix’s recommendation engine and self-driving cars. The key aspect of AI systems is that they adapt in real time, as opposed to traditional systems which are pre-programmed to obey a static set of rules.

AI algorithms could realistically drive smart glass facades or products more intelligently, and even pre-empt certain dangerous or undesirable circumstances.

= Can smart glass 'learn'? =

Smart glass itself is just a material, like concrete, stone or wood, with the key difference being the change in its optical properties when driven by a stimulus. When coupled with an AI system, the whole ‘smart glass system’ could learn, but this depends on whether there is a dataset to teach the system the difference between 'good' and 'bad'. And this depends on whether there are sufficient real-time sensors recording the events which feed this dataset.

Based on the use cases outlined above, these ‘sensors’ might include:

* AI bots that monitor social media chatter, alerting law enforcement agencies to increased risks of a threat to the public;
* AI computer vision systems that recognise a known felon in the vicinity of likely targets of theft;
* AI light exposure monitors that predict an increased risk of damage to light-sensitive materials such as art, textiles, pharmaceutical drugs, as well as phototoxic oils, perfumes and dyes.

= ArtRatio =

At ArtRatio, we are not yet using AI but rather a modified version of a PID (Proportional–Integral–Derivative) algorithm, similar to what you would find in a cruise control system in a car. Our algorithm is adaptive. It is real-time. But it is not AI (yet). It is sufficiently novel and ‘non-obvious’ though, that we were granted a European Patent for it in 2021.

Here is the reason why: If you subject an unpainted stone sculpture to light levels of say 500 Lux, it will not suffer noticeable deterioration. However, if you put a 15th century silk antiquity under those same light conditions, it can deteriorate in a matter of days. The inventories of museums, auction houses, corporate art collectors or luxury retailers can amount to hundreds of billions of Dollars, and this value is literally being erased by light exposure.

However, not all objects are the same. For this reason, ArtRatio smart glass vitrines modify their behaviour in real time based on what is being displayed, as well as local environmental variables and visitor engagement.

Some materials can be sensitive to light, but others are sensitive to temperature or humidity. Since about 50% of solar radiation is infrared (i.e. heat), incoming sunlight can increase the local temperature inside a display case, which decreases the relative humidity in the enclosed space. So, you see: light, temperature, humidity and even the electrical conductivity of air are all connected, with the damage often being driven by incoming light. And since active smart glass is an electrically-controllable light filter, it seems obvious to use it to do just that, whether in the form of a display case, or by installing the smart glass on the building facade itself.

= Case studies =

== The Waterloo Map ==

During the course of this project, the museum conservators informed us that the map was very sensitive to light exposure. Moreover, the map still had the original pencil markings of the first Duke of Wellington on it (as well as blood from one of the soldiers who was carrying the map on his body when he was killed in battle), so all measures should be taken to avoid damage to these materials.

One measure we took was to control the light exposure, of course, but another was to control the relative humidity inside the frame, giving rise to two benefits:-

# This minimises any mould or insects from damaging the map, thanks to the controlled microclimate inside the display frame.
# The second issue is due to the inherent ability of glass to collect electrostatic charge, which builds up when we walk across a woollen carpet, for example. This is the 'triboelectric effect'.

This can result in very high electrostatic voltages accumulating on our bodies, reaching up to 30 kV. Ensuring the humidity remains between a target of 45%-50% stops the air from drying out. If the humidity were to fall below that figure, the drier air, containing less water, can prevent any electrostatic charge on highly insulative surfaces (like acrylic and glass) from dissipating naturally to electrical earth through the water molecules in the air.

In the worst case, the resulting electric field can ‘lift off’ friable media on artworks, like chalk, charcoal and the graphite pencil markings made by the first Duke of Wellington on the Waterloo map.

In this case, since the smart glass is in very close proximity to a 200 year old original map of iconic importance to British military history, we took great precautions to ensure the smart glass did not damage the fragile pencil markings due to any electrostatic fields on the glass interior surface.

= What does the future hold for smart glass? =

Our collective journey into adaptive, intelligent smart glass building facades, smart glass showcases and smart glass enabled transportation has just begun. We have merely scratched the surface of the available use cases so far. Continued advances in materials and algorithms will benefit sectors where smart glass is already being used; from transportation to retail; from hospitality to heritage to healthcare.

What is really exciting is that global initiatives such as the push towards sustainability and user privacy are driving us to a future that may be beautifully illuminated by natural daylight, managed judiciously by smart glass.

= Author Bio =

Manoj’s first experience with glass goes back to the fabrication of optical waveguides as a final year project at the Optoelectronics Research Centre (Southampton University) in 1989, sponsored by Ferranti Semiconductors in the UK.

Manoj worked initially as a Trainee Patent Agent in London representing semiconductor firms at the UK, European and US patent offices, before embarking on a career as a Software Engineer across telecommunications, automotive, finance and eGovernment sectors.

Manoj founded ArtRatio in 2008 to build smart glass display cases for museums and luxury retailers, and launched SmartGlassWorld thereafter to promote development in smart materials.

Manoj’s experience as a manufacturer of smart glass end-products and as a smart glass distributor & consultant allows for a deep understanding of what customers need in order to achieve a return on investment in smart glass technologies.

Manoj is a UK Chartered Engineer with a Bachelors in Electronics Engineering from Southampton University and a Masters in Software Engineering from Oxford University, and is a guest lecturer on the MA Art Logistics programme at Sotheby's Institute of Art in London.

--[[User:Smartglassworld|Smartglassworld]] 15:27, 05 Sep 2022 (BST)

[[Category:DCN_Product_Knowledge]] [[Category:Projects_and_case_studies]] [[Category:Research_/_Innovation]] [[Category:Products_/_components]] [[Category:Conservation]]

Smart glass and artificial intelligence

2022-09-05T07:03:08Z

Smartglassworld:

= Smart Glass & Artificial Intelligence =

Smart Glass is only as smart as the control system that drives it.

Whether it is for viewing the exterior world from within buildings or vehicles, or filtering incoming daylight onto interiors, smart glass systems must now evolve to a position where they are continuously learning from their environment, adapting to changes in local and global events.

For this, the future of smart glass systems must reside with artificial intelligence.

== Let me explain ==

Your smartphone can adjust its behaviour based on your personal data and local events, right?

Examples include :

* dimming down the screen when the battery is low,
* detecting the risk of a heart attack using a medical app, and
* finding the best sushi restaurant, near you, right now.

Similarly, a smart glass system should also be able to adjust its behaviour based on what is happening in its local environment and what it is learning from global events as they unfold in real-time.

== Use Cases ==

We have seen some excellent examples in the news recently from smart glass manufacturers such as View and Halio in which proprietary artificial intelligence (AI) algorithms adapt building facades to changes in sunlight, with clear benefits (pun intended) for sustainability, privacy and comfort.

Let us now consider some more advanced use cases that would take this a step further:-

=== Security Threats in Large Cities ===

Just as car doors unlock automatically on detecting an accident, smart glass facades could also default to a 'safe' transparent state in emergency situations.

For example, if an AI law enforcement app monitoring social media chatter detected an imminent terrorist threat in a large city during a bright sunny day, it is probable that any building with a smart glass facade would be in its energy-filtering ‘dark mode’, to minimise glare and air conditioning costs.

This dark mode however would also impair visibility into the building for law enforcement and security agencies trying to ensure everyone has been evacuated from the building.

In this case, smart glass facades in the immediate vicinity of the security threat could automatically transition to an ‘emergency mode’ in which they are held indefinitely in a transparent state, aiding visual communication.

This same principle could also be applied to smart glass systems installed in transportation, enabling a visual line of communication with passengers trapped after an accident, or when the vehicle predicts the risk of a stranded infant or pet suffering possible dehydration.

=== Theft of High-Value Items ===

Whether in a private residence, a high-end jewellery store or an art gallery, if smart glass is being used in external windows, interior partitions or in showcases, and if the AI algorithm monitoring CCTV cameras anticipates an imminent theft, the smart glass system could ‘go dark’, obscuring the items and slowing down the attacker from finding the most valuable pieces.

When the premises are closed, security guards still need to be able to see the displayed items while on patrol. However, if the building security is likely to be breached, the sensible solution would be to hide everything from view. Not just the most valuable items, but everything.

It may not necessarily stop the attacker but it can slow them down, giving security or law enforcement agents extra time to respond.

=== Reducing Light Damage in Museums and Luxury Retail ===

Global art and luxury retail inventories worldwide can amount to Billions of Dollars in assets, but excessive light exposure can cause severe damage to paintings, rare books, fashion textiles and even [https://www.artratio.co.uk/protecting-fine-wine-collections-from-light-exposure fine wines], thus hurting their market value.

If the smart glass control system ‘knew’ which materials were on display (and their sensitivity), it could dim the glass down a few notches.

This change in illuminance would be practically imperceptible to humans since the eye is an approximately logarithmic sensor (Weber–Fechner law), but it would substantially reduce the long term damage to artworks and luxury materials, since light exposure is the time-integral of the light level. i.e. we calculate light exposure by multiplying the light level by the exposure time.

Future smart glass systems should also learn to automatically identify which items are most vulnerable to damage using AI-enabled machine vision, adjust their behaviour proactively and intelligently to preserve the value of the items displayed.

Let’s now take a step back and break down the basic building blocks to understand such AI-driven smart glass systems:-

== Firstly, What is Smart Glass? ==

Smart glass is not a product, but rather a family of technologies.

Broadly speaking, this family can be divided into two major groups: ‘passive’ and ‘active’.

In both cases, a stimulus triggers changes in certain properties of smart glass, such as its transmittance, its reflectance, its ability to refract light (i.e. scatter light) and even its electrical conductivity.

Passive smart glass reacts to environmental stimuli such as light or temperature. Examples include thermochromic and photochromic smart glass which dim in response to heat or ultraviolet light (respectively).

This ability to dynamically reject various spectral portions of solar radiation can reduce air conditioning costs in buildings and vehicles, reduce glare for office workers and reduce damage to interior furnishings and retail inventories.

Active smart glass on the other hand is driven electrically, triggered by manual switches, sensors or control commands from a building management system (BMS).

Examples of active smart glass technologies include:

* suspended particle devices (SPD-SmartGlass), patented by Research Frontiers Inc.
* electrophoretic smart glass technology, such as eLstar Dynamics
* liquid crystal smart glass such as Merck Eyrise or Smartglass International (note: when the liquid crystals are dispersed in a polymer film this technology is called ‘PDLC’ smart glass),
* electrochromic glass (examples include View, Halio and SageGlass) and
* micro-blinds, created by the National Research Council of Canada (NRC).

You can find more on [https://www.smartglassworld.net Smart Glass World], a site we created to educate our customers (mainly architects and interior designers) in smart glass technologies.

Within the smart glass family we could also reasonably include ‘transparent photovoltaic’ (TPV) glass, which converts part of the electromagnetic spectrum into electricity (albeit not as efficiently as solar cells).

Examples include products from Ubiquitous Energy and Clearvue Technologies.

The advantage of TPV smart glass over solar cells is that the former is transparent to visible light, thus allowing its use as 'electricity-generating windows' in exterior building facades. When incorporated directly onto the building facade, it is often referred to as 'Building-Integrated Photovoltaics' (BIPV).

Other materials which can be classified within the ‘smart glass family’ include smart mirrors, augmented-reality spectacles (think Vuzix, RealWear, Google Glass or the much-anticipated [https://appleinsider.com/inside/apple-glass Apple Glass]) and existing heads-up displays (HUDs) for transportation.

== Where does Artificial Intelligence fit into all this? ==

Artificial intelligence (AI) aims to predict future outcomes based on historical data, rather than relying on pre-programmed rules.

The system is ‘trained’ to recognise patterns, behaviours or properties and, over time, learns what response to execute.

Artificial intelligence (AI) is often seen as an umbrella term, encompassing Machine Learning, which can be specialised to Deep Learning and further specialised to Neural Networks.

For the purposes of this article, we will not delve further into the differences between these sub fields.

Current examples of AI applications include automated stock trading, customer service chatbots, Netflix’s recommendation engine and self-driving cars.

The key aspect of AI systems is that they adapt in real time, as opposed to traditional systems which are pre-programmed to obey a static set of rules.

AI algorithms could realistically drive smart glass facades or products more intelligently, and even pre-empt certain dangerous or undesirable circumstances, as outlined in the use cases described earlier.

== Can Smart Glass 'learn'? ==

Smart glass itself is just a material, like concrete, stone or wood, with the key difference being the change in its optical properties when driven by a stimulus.

When coupled with an AI system, the whole ‘smart glass system’ could indeed learn, but this depends on whether there is a dataset to teach the system the difference between 'good' and 'bad'.

And this depends on whether there are sufficient real-time sensors recording the events which feed this dataset.

Based on the use cases outlined above, these ‘sensors’ might include:

* AI bots that monitor social media chatter, alerting law enforcement agencies to increased risks of a threat to the public;
* AI computer vision systems that recognise a known felon in the vicinity of likely targets of theft;
* AI light exposure monitors that predict an increased risk of damage to light-sensitive materials such as art, textiles, pharmaceutical drugs, as well as phototoxic oils, perfumes and dyes.

== --- FEEL FREE TO EDIT OUT THE FOLLOWING 2 SECTIONS IF YOU FIND THEY ARE TOO ADVERTORIAL --- ==

== About ArtRatio ==

At ArtRatio, we are not yet using AI but rather a modified version of a PID (Proportional–Integral–Derivative) algorithm, similar to what you would find in a cruise control system in a car.

Our algorithm is adaptive. It is real-time. But it is not AI (yet).

It is sufficiently novel and ‘non-obvious’ though, that we were granted a European Patent for it in 2021.

Here is the reason why:

If you subject an unpainted stone sculpture to light levels of say 500 Lux, it will not suffer noticeable deterioration.

However, if you put a 15th century silk antiquity under those same light conditions, it can deteriorate in a matter of days.

The inventories of museums, auction houses, corporate art collectors or luxury retailers can amount to hundreds of billions of Dollars, and this value is literally being erased by light exposure.

However, not all objects are the same.

For this reason, ArtRatio smart glass vitrines modify their behaviour in real time based on what is being displayed, as well as local environmental variables and visitor engagement.

Some materials can be sensitive to light, but others are sensitive to temperature or humidity.

Since about 50% of solar radiation is infrared (i.e. heat), incoming sunlight can increase the local temperature inside a display case, which decreases the relative humidity in the enclosed space.

So, you see: light, temperature, humidity and even the electrical conductivity of air are all connected, with the damage often being driven by incoming light.

And since active smart glass is an electrically-controllable light filter, it seems obvious to use it to do just that, whether in the form of a display case, or by installing the smart glass on the building facade itself.

== ArtRatio Case Studies ==

ArtRatio has implemented smart glass display vitrines for museums, private collectors and luxury retailers, including most recently a library in Boston and an exhibition of patrimonial jewellery for a major European luxury house.

Unfortunately, non-disclosure agreements prevent me from saying more, but stay tuned to our social media channels to see photos and videos when the above-mentioned work can be officially revealed.

Our customers include the National Museum of Sweden, Sotheby’s Institute of Art and the Wellcome Trust.

One project which I can discuss is our smart glass wall-hangable display frame which protects the original map of the 1815 Battle of Waterloo at the Royal Engineers Museum in the UK.

=== The Waterloo Map ===

During the course of this project, the museum conservators informed us that the map was very sensitive to light exposure.

Moreover, the map still had the original pencil markings of the first Duke of Wellington on it (as well as blood from one of the soldiers who was carrying the map on his body when he was killed in battle), so all measures should be taken to avoid damage to these materials.

One measure we took was to control the light exposure, of course, but another was to control the relative humidity inside the frame, giving rise to two benefits:-

1. This minimises any mould or insects from damaging the map, thanks to the controlled microclimate inside the display frame.

2. The second issue is due to the inherent ability of glass to collect electrostatic charge, which builds up when we walk across a woollen carpet, for example. This is the 'triboelectric effect'.

This can result in very high electrostatic voltages accumulating on our bodies, reaching up to 30 kV. Ensuring the humidity remains between a target of 45%-50% stops the air from drying out.

If the humidity were to fall below that figure, the drier air, containing less water, can prevent any electrostatic charge on highly insulative surfaces (like acrylic and glass) from dissipating naturally to electrical earth through the water molecules in the air.

In the worst case, the resulting electric field can ‘lift off’ friable media on artworks, like chalk, charcoal and - yes you guessed it - the graphite pencil markings made by the first Duke of Wellington on the Waterloo map.

Who would have thought that the electrical conductivity of air can be so directly influenced by humidity?

In this case, since the smart glass is in very close proximity to a 200 year old original map of iconic importance to British military history, we took great precautions to ensure the smart glass did not damage the fragile pencil markings due to any electrostatic fields on the glass interior surface.

You can read more about the Waterloo Map at [https://www.artratio.co.uk/waterloo-map-1815 this link].

Across all our installations, our patented algorithm and cloud-based analytics platform automatically balance the exhibition with the conservation of fragile works of art, allowing our customers to decide whether to display, conserve, store, loan or sell the items.

Our next step, as you can imagine, will be to transition our algorithm to one based on machine learning (AI).

== What does the future hold for smart glass? ==

Our collective journey into adaptive, intelligent smart glass building facades, smart glass showcases and smart glass enabled transportation has just begun.

We have merely scratched the surface of the available use cases so far.

Continued advances in materials and algorithms will benefit sectors where smart glass is already being used; from transportation to retail; from hospitality to heritage to healthcare.

What is really exciting is that global initiatives such as the push towards sustainability and user privacy are driving us to a future that may be beautifully illuminated by natural daylight, managed judiciously by smart glass.

= Author Bio =

Manoj’s first experience with glass goes back to the fabrication of optical waveguides as a final year project at the Optoelectronics Research Centre (Southampton University) in 1989, sponsored by Ferranti Semiconductors in the UK.

Manoj worked initially as a Trainee Patent Agent in London representing semiconductor firms at the UK, European and US patent offices, before embarking on a career as a Software Engineer across telecommunications, automotive, finance and eGovernment sectors.

Manoj founded ArtRatio in 2008 to build smart glass display cases for museums and luxury retailers, and launched SmartGlassWorld thereafter to promote development in smart materials.

Manoj’s experience as a manufacturer of smart glass end-products and as a smart glass distributor & consultant allows for a deep understanding of what customers need in order to achieve a return on investment in smart glass technologies.

Manoj is a UK Chartered Engineer with a Bachelors in Electronics Engineering from Southampton University and a Masters in Software Engineering from Oxford University, and is a guest lecturer on the MA Art Logistics programme at Sotheby's Institute of Art in London.

[[Category:Projects_and_case_studies]] [[Category:Research_/_Innovation]] [[Category:Products_/_components]] [[Category:Conservation]]

Smart glass and artificial intelligence

2022-09-04T20:47:17Z

Smartglassworld:

= Smart Glass & Artificial Intelligence =

Smart Glass is only as smart as the control system that drives it.

Whether it is for viewing the exterior world from within buildings or vehicles, or filtering incoming daylight onto interiors, smart glass systems must now evolve to a position where they are continuously learning from their immediate environment, adapting to changes in local and global events.

For this, the future of smart glass systems must reside with artificial intelligence.

== Let me explain ==

Your smartphone can adjust its behaviour based on your personal data and local events, right?

Examples include :

* dimming down the screen when the battery is low,
* detecting the risk of a heart attack using a medical app, and
* finding the best sushi restaurant, near you, right now.

Similarly, a smart glass system should also be able to adjust its behaviour based on what is happening in its local environment and what it is learning from global events as they unfold in real-time.

== Use Cases ==

We have seen some excellent examples in the news recently from smart glass manufacturers such as View and Halio in which proprietary artificial intelligence (AI) algorithms adapt building facades to changes in sunlight, with clear benefits (pun intended) for sustainability, privacy and comfort.

Let us now consider some more advanced use cases that would take this a step further:-

=== Security Threats in Large Cities ===

Just as car doors unlock automatically on detecting an accident, smart glass facades could also default to a transparent state in emergency situations.

For example, if an AI agent monitoring social media chatter detected an imminent terrorist threat in a large city during a bright sunny day, it is probable that any building with a smart glass facade would be in its energy-filtering ‘dark mode’, to minimise glare and air conditioning costs.

This dark mode however would also impair visibility into the building for law enforcement and security agencies trying to ensure everyone has been evacuated from the building.

In this case, smart glass facades in the immediate vicinity of the security threat could automatically transition to an ‘emergency mode’ in which they are held indefinitely in a transparent state, aiding visual communication.

The same principle could also be applied to smart glass systems installed on transportation, enabling a visual line of communication with passengers trapped after an accident, or when the vehicle predicts the risk of an stranded infant or pet suffering possible dehydration.

=== Theft of High-Value Items ===

Whether in a private residence, a high-end jewellery store or an art gallery, if smart glass is being used on walls or in showcases, and if the AI algorithm monitoring CCTV cameras anticipates an imminent theft, the smart glass system could ‘go dark’, obscuring the items and slowing down the attacker from finding the most valuable pieces.

When the premises are closed, security guards still need to be able to see the displayed items while on patrol. However, if the building security is likely to be breached, the sensible solution would be to hide everything from view. Not just the most valuable items, but everything.

It may not necessarily stop the attacker but it can slow them down, giving security or law enforcement agents extra time to respond.

=== Reducing Light Damage in Museums and Luxury Retail ===

Global art and luxury retail inventories worldwide can amount to Billions of Dollars in assets, but excessive light exposure can cause severe damage to paintings, fashion textiles and even [https://www.artratio.co.uk/protecting-fine-wine-collections-from-light-exposure fine wines], thus hurting their market value.

If the smart glass control system ‘knew’ which materials were on display (and their sensitivity), it could dim the glass down a few notches.

This change in illuminance would be practically imperceptible since the eye is an approximately logarithmic sensor (Weber–Fechner law), but it would substantially reduce the long term damage from light, since light exposure is the time-integral of the light level.

Future smart glass systems should also learn to automatically identify which items are most vulnerable to damage using machine vision, then adjust their behaviour proactively and intelligently to preserve their value.

Let’s now take a step back and break down the basic building blocks to understanding such AI-driven smart glass systems:-

== Firstly, What is Smart Glass? ==

Smart glass is not a product, but rather a family of technologies.

Broadly speaking, this family can be divided into two major groups: ‘passive’ and ‘active’.

In both cases, a stimulus triggers changes in certain properties of smart glass, such as its transmittance, reflectance, refraction (i.e. scattering of light) or even its electrical conductivity.

Passive smart glass reacts to environmental stimuli such as light or temperature. Examples include thermochromic and photochromic smart glass which dim in response to heat or ultraviolet light (respectively).

This ability to dynamically reject various spectral portions of solar radiation can reduce air conditioning costs in buildings and vehicles, reduce glare for office workers and reduce damage to interior furnishings and retail inventories.

Active smart glass on the other hand is driven electrically, triggered by manual switches, sensors or control commands from a building management system (BMS).

Examples of active smart glass technologies include:

* suspended particle devices (SPD-SmartGlass), patented by Research Frontiers Inc.
* electrophoretic smart glass technology, such as eLstar Dynamics
* liquid crystal smart glass such as Merck Eyrise or Smartglass International (note: when the liquid crystals are dispersed in a polymer film this technology is called ‘PDLC’ smart glass),
* electrochromic glass (examples include View, Halio and SageGlass) and
* micro-blinds, created by the National Research Council of Canada (NRC).

You can find more on [https://www.smartglassworld.net Smart Glass World], a site we created to educate our customers in smart glass technologies.

Within the smart glass family we could also reasonably include ‘transparent photovoltaic’ (TPV) glass, which converts part of the electromagnetic spectrum into electricity (albeit not as efficiently as solar cells).

Examples include Ubiquitous Energy and Clearvue Technologies.

The advantage is that TPV glass is - well - transparent, thus allowing its use as 'electricity-generating windows' in exterior building facades. When incorporated directly into the building facade, it is often referred to as 'Building-Integrated Photovoltaics' (BIPV).

Other materials which can be classified within the ‘smart glass family’ include smart mirrors, augmented-reality spectacles (think Vuzix, RealWear, Google Glass or the much-anticipated [https://appleinsider.com/inside/apple-glass Apple Glass]) and existing heads-up displays (HUDs) for transportation.

== Where does Artificial Intelligence fit into all this? ==

Artificial intelligence (AI) aims to predict future outcomes based on historical data, rather than relying on pre-programmed rules.

The system is ‘trained’ to recognise patterns, behaviours or properties and, over time, learns what response to execute.

Artificial intelligence (AI) is often seen as an umbrella term, encompassing Machine Learning, which can be specialised to Deep Learning and further specialised to Neural Networks.

For the purposes of this article, we will not delve further into the differences between these sub fields.

Current examples of AI applications include automated stock trading, customer service chatbots, Netflix’s recommendation engine and self-driving cars.

The key aspect of AI systems is that they adapt in real time, as opposed to traditional systems which are pre-programmed to obey a static set of rules.

AI algorithms could realistically drive smart glass facades or products more intelligently, and even preempt certain dangerous or undesirable circumstances, as outlined in the use cases described earlier.

== Can Smart Glass 'learn'? ==

Smart glass itself is just a material, like concrete, stone or wood, with the key difference being the change in its optical properties when driven by a stimulus.

When coupled with an AI system, the whole ‘smart glass system’ could indeed learn, but this depends on whether there is a dataset to teach the system the difference between 'good' and 'bad'.

And this depends on whether there are sufficient real-time sensors recording the events which feed this dataset.

Based on the use cases outlined above, these ‘sensors’ might include:

* AI bots that monitor social media chatter, alerting law enforcement agencies to increased risks of a threat to the public;
* an AI computer vision system recognising a known felon in the vicinity of likely targets of theft;
* AI light exposure monitors that predict an increased risk of damage to light-sensitive materials such as art, textiles, pharmaceutical drugs, as well as phototoxic oils, perfumes and dyes.

== --- FEEL FREE TO EDIT OUT THE FOLLOWING 2 SECTIONS IF YOU FIND THEY ARE TOO ADVERTORIAL --- ==

== About ArtRatio ==

At ArtRatio, we are not yet using AI but rather a modified version of a PID (Proportional–Integral–Derivative) algorithm, similar to what you would find in a cruise control system in a car.

Our algorithm is adaptive. It is real-time. But it is not AI (yet).

It is sufficiently novel and ‘non-obvious’ though, that we were granted a European Patent for it in 2021.

Here is the reason why:

If you subject an unpainted stone sculpture to light levels of say 500 Lux, it will not suffer noticeable deterioration.

However, if you put a silk antiquity under those same light conditions, it can deteriorate in a matter of days or weeks.

The inventories of museums, auction houses, corporate art collectors or luxury retailers can amount to hundreds of billions of Dollars, so this value is literally being erased by light exposure.

However, not all objects are the same.

For this reason, ArtRatio smart glass vitrines modify their behaviour in real time based on what is being displayed, as well as local environmental variables and visitor engagement.

Some materials can be sensitive to light, but others are sensitive to temperature or humidity.

Since about 50% of solar radiation is infrared (i.e. heat), incoming sunlight can increase the local temperature inside a display case, which decreases the relative humidity in the enclosed space.

So, you see: light, temperature, humidity and even the electrical conductivity of air are all connected, with the damage often being driven by incoming light.

And since active smart glass is an electrically-controllable light filter, it seems obvious to use it to do just that.

== ArtRatio Case Studies ==

ArtRatio has implemented smart glass display vitrines for museums, private collectors and luxury retailers, including most recently a library in Boston and an exhibition of patrimonial jewellery for a major European luxury house.

Unfortunately, non-disclosure agreements prevent me from saying more, but stay tuned to our social media channels to see photos and videos when the above-mentioned work can be officially revealed.

Our customers include the National Museum of Sweden, Sotheby’s Institute of Art and the Wellcome Trust.

One project which I can discuss is our smart glass wall-hangable display frame which protects the original map of the 1815 Battle of Waterloo at the Royal Engineers Museum in the UK.

=== The Waterloo Map ===

During the course of this project, the museum conservators informed us that the map was very sensitive to light exposure.

Moreover, the map still had the original pencil markings of the first Duke of Wellington on it (as well as blood from one of the soldiers who was carrying the map on his body when he was killed in battle), so all measures should be taken to avoid damage to these materials.

One measure we took was to control the light exposure, of course, but another was to control the relative humidity inside the frame, giving rise to two benefits:-

1. This minimises any mould or insects from damaging the map, thanks to the controlled microclimate inside the display frame.

2. The second issue is due to the inherent ability of glass to collect electrostatic charge, which builds up when we walk across a woollen carpet, for example. This is the 'triboelectric effect'.

This can result in very high electrostatic voltages accumulating on our bodies, reaching up to 30 kV. Ensuring the humidity remains between a target of 45%-50% stops the air from drying out.

If the humidity were to fall below that figure the drier air, containing less water, can prevent any electrostatic charge on highly insulative surfaces (like acrylic and glass) from dissipating naturally to electrical earth.

In the worst case, the resulting electric field can ‘lift off’ friable media on artworks, like chalk, charcoal and the graphite pencil markings made by the first Duke of Wellington on the Waterloo map.

Who would have thought that the electrical conductivity of air can be so directly influenced by humidity?

In this case, since the smart glass is in very close proximity to a 200 year old original map of iconic importance to British military history, we took great precautions to ensure the smart glass did not damage the fragile pencil markings due to any electrostatic field on the glass interior surface.

You can read more about the Waterloo Map at [https://www.artratio.co.uk/waterloo-map-1815 this link].

Across all our installations, our patented algorithm and cloud-based analytics platform automatically balance the exhibition with the conservation of fragile works of art, allowing our customers to decide whether to display, conserve, store, loan or sell the items.

Our next step, as you can imagine, will be to transition our algorithm to one based on machine learning (AI).

== What does the future hold for smart glass? ==

Our collective journey into adaptive, intelligent smart glass building facades, smart glass showcases and smart glass enabled transportation has just begun.

We have merely scratched the surface of the available use cases so far.

Continued advances in materials and algorithms will benefit sectors where smart glass is already being used; from transportation to retail; from hospitality to heritage to healthcare.

What is really exciting is that global initiatives such as the push towards sustainability and user privacy are driving us to a future that may be beautifully illuminated by natural daylight, managed judiciously by smart glass.

= Author Bio =

Manoj’s first experience with glass goes back to the fabrication of optical waveguides as a final year project at the Optoelectronics Research Centre (Southampton University) in 1989, sponsored by Ferranti Semiconductors in the UK.

Manoj worked initially as a Trainee Patent Agent in London representing semiconductor firms at the UK, European and US patent offices, before embarking on a career as a Software Engineer across telecommunications, automotive, finance and eGovernment sectors.

Manoj founded ArtRatio in 2008 to build smart glass display cases for museums and luxury retailers, and launched SmartGlassWorld thereafter to promote development in smart materials.

Manoj’s experience as a manufacturer of smart glass end-products and as a smart glass distributor & consultant allows for a deep understanding of what customers need in order to achieve a return on investment in smart glass technologies.

Manoj is a UK Chartered Engineer with a Bachelors in Electronics Engineering from Southampton University and a Masters in Software Engineering from Oxford University, and is a guest lecturer on the MA Art Logistics programme at Sotheby's Institute of Art in London.

[[Category:Projects_and_case_studies]] [[Category:Research_/_Innovation]] [[Category:Products_/_components]] [[Category:Conservation]]

Smart glass and artificial intelligence

2022-09-04T20:31:20Z

Smartglassworld:

= Smart Glass & Artificial Intelligence =

Smart Glass is only as smart as the control system that drives it.

Whether it is for viewing the exterior world from within buildings or vehicles, or filtering incoming daylight onto interiors, smart glass systems must now evolve to a position where they are continuously learning from their immediate environment, adapting to changes in local and global events.

For this, the future of smart glass systems must reside with artificial intelligence.

== Let me explain ==

Your smartphone can adjust its behaviour based on your personal data and local events, right?

Examples include :

* dimming down the screen when the battery is low,
* detecting the risk of a heart attack using a medical app, and
* finding the best sushi restaurant, near you, right now.

Similarly, a smart glass system should also be able to adjust its behaviour based on what is happening in its local environment and what it is learning from global events as they unfold in real-time.

== Use Cases ==

We have seen some excellent examples in the news recently from smart glass manufacturers such as View and Halio in which proprietary artificial intelligence (AI) algorithms adapt building facades to changes in sunlight, with clear benefits (pun intended) for sustainability, privacy and comfort.

Let us now consider some more advanced use cases that would take this a step further:-

=== Security Threats in Large Cities ===

Just as car doors unlock automatically on detecting an accident, smart glass facades could also default to a transparent state in emergency situations.

For example, if an AI agent monitoring social media chatter detected an imminent terrorist threat in a large city during a bright sunny day, it is probable that any building with a smart glass facade would be in its energy-filtering ‘dark mode’, to minimise glare and air conditioning costs.

This dark mode however would also impair visibility into the building for law enforcement and security agencies trying to ensure everyone has been evacuated from the building.

In this case, smart glass facades in the immediate vicinity of the security threat could automatically transition to an ‘emergency mode’ in which they are held indefinitely in a transparent state, aiding visual communication.

The same principle could also be applied to smart glass systems installed on transportation, enabling a visual line of communication with passengers trapped after an accident, or when the vehicle predicts the risk of an stranded infant or pet suffering possible dehydration.

=== Theft of High-Value Items ===

Whether in a private residence, a high-end jewellery store or an art gallery, if smart glass is being used on walls or in showcases, and if the AI algorithm monitoring CCTV cameras anticipates an imminent theft, the smart glass system could ‘go dark’, obscuring the items and slowing down the attacker from finding the most valuable pieces.

When the premises are closed, security guards still need to be able to see the displayed items while on patrol. However, if the building security is likely to be breached, the sensible solution would be to hide everything from view. Not just the most valuable items, but everything.

It may not necessarily stop the attacker but it can slow them down, giving security or law enforcement agents extra time to respond.

=== Reducing Light Damage in Museums and Luxury Retail ===

Global art and luxury retail inventories worldwide can amount to Billions of Dollars in assets, but excessive light exposure can cause severe damage to paintings, fashion textiles and even [https://www.artratio.co.uk/protecting-fine-wine-collections-from-light-exposure fine wines], thus hurting their market value.

If the smart glass control system ‘knew’ which materials were on display (and their sensitivity), it could dim the glass down a few notches.

This change in illuminance would be practically imperceptible since the eye is an approximately logarithmic sensor (Weber–Fechner law), but it would substantially reduce the long term damage from light, since light exposure is the time-integral of the light level.

Future smart glass systems should also learn to automatically identify which items are most vulnerable to damage using machine vision, then adjust their behaviour proactively and intelligently to preserve their value.

Let’s now take a step back and break down the basic building blocks to understanding such AI-driven smart glass systems:-

== Firstly, What is Smart Glass? ==

Smart glass is not a product, but rather a family of technologies.

Broadly speaking, this family can be divided into two major groups: ‘passive’ and ‘active’.

In both cases, a stimulus triggers changes in certain properties of smart glass, such as its transmittance, reflectance, refraction (i.e. scattering of light) or even its electrical conductivity.

Passive smart glass reacts to environmental stimuli such as light or temperature. Examples include thermochromic and photochromic smart glass which dim when struck by heat or ultraviolet light (respectively).

This ability to dynamically reject various spectral portions of solar radiation can reduce air conditioning costs in buildings and vehicles, reduce glare for office workers and reduce damage to interior furnishings and retail inventories.

Active smart glass on the other hand is driven electrically, often triggered by sensors or control commands from a building management system (BMS).

Examples of active smart glass technologies include:

* suspended particle devices (SPD-SmartGlass), created by Research Frontiers Inc.
* electrophoretic smart glass technology, such as eLstar Dynamics
* liquid crystal smart glass such as Merck Eyrise or Smartglass International (note: when the liquid crystals are dispersed in a polymer film this technology is called ‘PDLC’ smart glass),
* electrochromic glass (examples include View, Halio and SageGlass) and
* micro-blinds, created by the National Research Council of Canada (NRC).

You can find more on [https://www.smartglassworld.net Smart Glass World], a site we created to educate our customers in smart glass technologies.

Within the active smart glass category we could also reasonably include ‘transparent photovoltaic’ (TPV) glass, which converts part of the electromagnetic spectrum into electricity (albeit not as efficiently as solar cells).

Examples include Ubiquitous Energy and Clearvue Technologies.

The advantage is that TPV glass is - well - transparent, thus allowing its use as 'electricity-generating windows' in exterior building facades. When incorporated directly into the building facade, it is often referred to as Building-Integrated Photovoltaics (BIPV).

Other materials which can be classified within the ‘smart glass family’ include smart mirrors, augmented-reality spectacles (think Vuzix, RealWear, Google Glass or the much-anticipated new [https://appleinsider.com/inside/apple-glass Apple Glass]) and existing heads-up displays (HUDs) for transportation.

== Where does Artificial Intelligence fit into all this? ==

Artificial intelligence (AI) aims to predict future outcomes based on historical data, rather than relying on pre-programmed rules.

The system is ‘trained’ to recognise patterns, behaviours or properties and, over time, learns what response to execute.

Artificial intelligence (AI) is often seen as an umbrella term, encompassing Machine Learning, which can be specialised to Deep Learning and further specialised to Neural Networks.

For the purposes of this article, we will not delve further into the differences between these sub fields.

Current examples of AI applications include automated stock trading, customer service chatbots, Netflix’s recommendation engine and self-driving cars.

The key aspect of AI systems is that they adapt in real time, as opposed to traditional systems which are pre-programmed to obey a static set of rules.

AI algorithms could realistically drive smart glass facades or products more intelligently, and even preempt certain dangerous or undesirable circumstances, as outlined in the use cases described earlier.

== Can Smart Glass 'learn'? ==

Smart glass itself is just a material, like concrete, stone or wood, with the key difference being the change in its optical properties when driven by a stimulus.

When coupled with an AI system, the whole ‘smart glass system’ could indeed learn, but this depends on whether there is a dataset to teach the system the difference between 'good' and 'bad'.

And this depends on whether there are sufficient real-time sensors recording the events which feed this dataset.

Based on the use cases outlined above, these ‘sensors’ might include:

* AI bots that monitor social media chatter, alerting law enforcement agencies to increased risks of a threat to the public;
* an AI computer vision system recognising a known felon in the vicinity of likely targets of theft;
* AI light exposure monitors that predict an increased risk of damage to light-sensitive materials such as art, textiles, pharmaceutical drugs, as well as phototoxic oils, perfumes and dyes.

== --- FEEL FREE TO EDIT OUT THE FOLLOWING 2 SECTIONS IF YOU FIND THEY ARE TOO ADVERTORIAL --- ==

== About ArtRatio ==

At ArtRatio, we are not yet using AI but rather a modified version of a PID (Proportional–Integral–Derivative) algorithm, similar to what you would find in a cruise control system in a car.

Our algorithm is adaptive. It is real-time. But it is not AI (yet).

It is sufficiently novel and ‘non-obvious’ though, that we were granted a European Patent for it in 2021.

Here is the reason why:

If you subject an unpainted stone sculpture to light levels of say 500 Lux, it will not suffer noticeable deterioration.

However, if you put a silk antiquity under those same light conditions, it can deteriorate in a matter of days or weeks.

The inventories of museums, auction houses, corporate art collectors or luxury retailers can amount to hundreds of billions of Dollars, so this value is literally being erased by light exposure.

However, not all objects are the same.

For this reason, ArtRatio smart glass vitrines modify their behaviour in real time based on what is being displayed, as well as local environmental variables and visitor engagement.

Some materials can be sensitive to light, but others are sensitive to temperature or humidity.

Since about 50% of solar radiation is infrared (i.e. heat), incoming sunlight can increase the local temperature inside a display case, which decreases the relative humidity in the enclosed space.

So, you see: light, temperature, humidity and even the electrical conductivity of air are all connected, with the damage often being driven by incoming light.

And since active smart glass is an electrically-controllable light filter, it seems obvious to use it to do just that.

== ArtRatio Case Studies ==

ArtRatio has implemented smart glass display vitrines for museums, private collectors and luxury retailers, including most recently a library in Boston and an exhibition of patrimonial jewellery for a major European luxury house.

Unfortunately, non-disclosure agreements prevent me from saying more, but stay tuned to our social media channels to see photos and videos when the above-mentioned work can be officially revealed.

Our customers include the National Museum of Sweden, Sotheby’s Institute of Art and the Wellcome Trust.

One project which I can discuss is our smart glass wall-hangable display frame which protects the original map of the 1815 Battle of Waterloo at the Royal Engineers Museum in the UK.

=== The Waterloo Map ===

During the course of this project, the museum conservators informed us that the map was very sensitive to light exposure.

Moreover, the map still had the original pencil markings of the first Duke of Wellington on it (as well as blood from one of the soldiers who was carrying the map on his body when he was killed in battle), so all measures should be taken to avoid damage to these materials.

One measure we took was to control the light exposure, of course, but another was to control the relative humidity inside the frame, giving rise to two benefits:-

1. This minimises any mould or insects from damaging the map, thanks to the controlled microclimate inside the display frame.

2. The second issue is due to the inherent ability of glass to collect electrostatic charge, which builds up when we walk across a woollen carpet, for example. This is the 'triboelectric effect'.

This can result in very high electrostatic voltages accumulating on our bodies, reaching up to 30 kV. Ensuring the humidity remains between a target of 45%-50% stops the air from drying out.

If the humidity were to fall below that figure the drier air, containing less water, can prevent any electrostatic charge on highly insulative surfaces (like acrylic and glass) from dissipating naturally to electrical earth.

In the worst case, the resulting electric field can ‘lift off’ friable media on artworks, like chalk, charcoal and the graphite pencil markings made by the first Duke of Wellington on the Waterloo map.

Who would have thought that the electrical conductivity of air can be so directly influenced by humidity?

In this case, since the smart glass is in very close proximity to a 200 year old original map of iconic importance to British military history, we took great precautions to ensure the smart glass did not damage the fragile pencil markings due to any electrostatic field on the glass interior surface.

You can read more about the Waterloo Map at [https://www.artratio.co.uk/waterloo-map-1815 this link].

Across all our installations, our patented algorithm and cloud-based analytics platform automatically balance the exhibition with the conservation of fragile works of art, allowing our customers to decide whether to display, conserve, store, loan or sell the items.

Our next step, as you can imagine, will be to transition our algorithm to one based on machine learning (AI).

== What does the future hold for smart glass? ==

Our collective journey into adaptive, intelligent smart glass building facades, smart glass showcases and smart glass enabled transportation has just begun.

We have merely scratched the surface of the available use cases so far.

Continued advances in materials and algorithms will benefit sectors where smart glass is already being used; from transportation to retail; from hospitality to heritage to healthcare.

What is really exciting is that global initiatives such as the push towards sustainability and user privacy are driving us to a future that may be beautifully illuminated by natural daylight, managed judiciously by smart glass.

= Author Bio =

Manoj’s first experience with glass goes back to the fabrication of optical waveguides as a final year project at the Optoelectronics Research Centre (Southampton University) in 1989, sponsored by Ferranti Semiconductors in the UK.

Manoj worked initially as a Trainee Patent Agent in London representing semiconductor firms at the UK, European and US patent offices, before embarking on a career as a Software Engineer across telecommunications, automotive, finance and eGovernment sectors.

Manoj founded ArtRatio in 2008 to build smart glass display cases for museums and luxury retailers, and launched SmartGlassWorld thereafter to promote development in smart materials.

Manoj’s experience as a manufacturer of smart glass end-products and as a smart glass distributor & consultant allows for a deep understanding of what customers need in order to achieve a return on investment in smart glass technologies.

Manoj is a UK Chartered Engineer with a Bachelors in Electronics Engineering from Southampton University and a Masters in Software Engineering from Oxford University, and is a guest lecturer on the MA Art Logistics programme at Sotheby's Institute of Art in London.

[[Category:Projects_and_case_studies]] [[Category:Research_/_Innovation]] [[Category:Products_/_components]] [[Category:Conservation]]

Smart glass and artificial intelligence

2022-09-04T19:49:49Z

Smartglassworld:

= Smart Glass & Artificial Intelligence =

Smart Glass is only as smart as the control system that drives it.

Whether it is for viewing the exterior world from within buildings or vehicles, or filtering incoming daylight onto interiors, smart glass systems must now evolve to a position where they are continuously learning from their immediate environment, adapting to changes in local and global events.

For this, the future of smart glass systems must reside with artificial intelligence.

== Let me explain ==

Your smartphone can adjust its behaviour based on your personal data and local events, right?

Examples include :

* dimming down the screen when the battery is low,
* detecting the risk of a heart attack using a medical app, and
* finding the best sushi restaurant, near you, right now.

Similarly, a smart glass system should also be able to adjust its behaviour based on what is happening in its local environment and what it is learning from global events as they unfold in real-time.

== Use Cases ==

We have seen some excellent examples in the news recently from smart glass manufacturers such as View and Halio in which proprietary artificial intelligence (AI) algorithms adapt building facades to changes in sunlight, with clear benefits (pun intended) for sustainability, privacy and comfort.

Let us now consider some more advanced use cases that would take this a step further:-

=== Security Threats in Large Cities ===

Just as car doors unlock automatically on detecting an accident, smart glass facades could also default to a transparent state in emergency situations.

For example, if an AI agent monitoring social media chatter detected an imminent terrorist threat in a large city during a bright sunny day, it is probable that any building with a smart glass facade would be in its energy-filtering ‘dark mode’, to minimise glare and air conditioning costs.

This dark mode however would also impair visibility into the building for law enforcement and security agencies trying to ensure everyone has been evacuated from the building.

In this case, smart glass facades in the immediate vicinity of the security threat could automatically transition to an ‘emergency mode’ in which they are held indefinitely in a transparent state, aiding visual communication.

The same principle could also be applied to smart glass systems installed on transportation, enabling a visual line of communication with passengers trapped after an accident, or when the vehicle predicts the risk of an stranded infant or pet suffering possible dehydration.

=== Theft of High-Value Items ===

Whether in a private residence, a high-end jewellery store or an art gallery, if smart glass is being used on walls or in showcases, and if the AI algorithm monitoring CCTV cameras anticipates an imminent theft, the smart glass system could ‘go dark’, obscuring the items and slowing down the attacker from finding the most valuable pieces.

When the premises are closed, security guards still need to be able to see the displayed items while on patrol. However, if the building security is likely to be breached, the sensible solution would be to hide everything from view. Not just the most valuable items, but everything.

It may not necessarily stop the attacker but it can slow them down, giving security or law enforcement agents extra time to respond.

=== Reducing Light Damage in Museums and Luxury Retail ===

Global art and luxury retail inventories worldwide can amount to Billions of Dollars in assets, but excessive light exposure can cause severe damage to paintings, fashion textiles and even [https://www.artratio.co.uk/protecting-fine-wine-collections-from-light-exposure fine wines], thus hurting their market value.

If the smart glass control system ‘knew’ which materials were on display (and their sensitivity), it could dim the glass down a few notches.

This change in illuminance would be practically imperceptible since the eye is an approximately logarithmic sensor (Weber–Fechner law), but it would substantially reduce the long term damage from light, since light exposure is the time-integral of the light level.

Future smart glass systems should also learn to automatically identify which items are most vulnerable to damage using machine vision, then adjust their behaviour proactively and intelligently to preserve their value.

Let’s now take a step back and break down the basic building blocks to understanding such AI-driven smart glass systems:-

== Firstly, What is Smart Glass? ==

Smart glass is not a product, but rather a family of technologies.

Broadly speaking, this family can be divided into two major groups: ‘passive’ and ‘active’.

In both cases, a stimulus triggers changes in certain properties of smart glass, such as its transmittance, reflectance, refraction (i.e. scattering of light) or even its electrical conductivity.

Passive smart glass reacts to environmental stimuli such as light or temperature. Examples include thermochromic and photochromic smart glass which dim when struck by heat or ultraviolet light (respectively).

Active smart glass, on the other hand, is driven electrically, often by way of sensors or control commands from a building management system (BMS).

Examples of active smart glass technologies include:

* suspended particle devices (SPD-SmartGlass), created by Research Frontiers Inc.
* liquid crystal technology such as Merck Eyrise or Smartglass International (note: when the crystals are dispersed in a polymer film this technology is called ‘PDLC’ smart glass),
* electrochromic glass (examples include View, Halio, SageGlass and Heliotrope) and
* micro-blinds, created by the National Research Council of Canada (NRC).

You can find more on [https://www.smartglassworld.net Smart Glass World], a site we created to educate our customers in smart glass technologies.

Within the active smart glass category we could also reasonably include ‘transparent photovoltaic’ (TPV) glass, which converts part of the electromagnetic spectrum into electricity (albeit not as efficiently as solar cells).

The advantage is that TPV glass is - well - transparent, thus allowing its use as windows in exterior building facades. When incorporated directly into the building facade, it is often referred to as Building-Integrated Photovoltaic (BIPV) glass.

Other materials which can be classified within the ‘smart glass family’ include smart mirrors, augmented-reality spectacles (think Vuzix, RealWear, Google Glass or the much-anticipated new [https://appleinsider.com/inside/apple-glass Apple Glass]) and existing heads-up displays (HUDs) for transportation.

== Where does Artificial Intelligence fit into all this? ==

Artificial intelligence (AI) aims to predict future outcomes based on historical data, rather than relying on pre-programmed rules.

The system is ‘trained’ to recognise patterns, behaviours or properties and, over time, learns what response to execute.

Artificial intelligence (AI) is often seen as an umbrella term, encompassing Machine Learning, which can be specialised to Deep Learning and further specialised to Neural Networks.

For the purposes of this article, we will not delve further into the differences between these sub fields.

Current examples of AI applications include automated stock trading, customer service chatbots, Netflix’s recommendation engine and self-driving cars.

The key aspect of AI systems is that they adapt in real time, as opposed to traditional systems which are pre-programmed to obey a static set of rules.

AI algorithms can drive smart glass facades or products more intelligently, and even preempt certain dangerous or undesirable circumstances.

== Can Smart Glass 'learn'? ==

Smart glass itself is just a material, like concrete, stone or wood, with the key difference being the change in its optical properties when driven by a stimulus, as described above.

However, when coupled with an AI system, the whole ‘smart glass system’ could indeed learn, but this depends on whether there is a dataset to teach the system what is ‘right’ and ‘wrong’.

And this depends on whether there are sufficient real-time sensors recording the events which feed this dataset.

Based on the use cases outlined above, these ‘sensors’ might include:

* bots that monitor social media chatter, alerting law enforcement agencies to increased risks of a threat to the public;
* a computer vision system recognising a known felon in the vicinity of likely targets of theft;
* light exposure monitors that predict an increased risk of damage to light-sensitive materials such as pharmaceutical drugs, phototoxic oils, perfumes and dyes.

== --- FEEL FREE TO EDIT OUT THE FOLLOWING 2 SECTIONS IF YOU FIND IT IS TOO ADVERTORIAL --- ==

== About ArtRatio ==

At ArtRatio, we are not yet using AI but rather a modified version of a PID (Proportional–Integral–Derivative) algorithm, similar to what you would find in a cruise control system in a car.

Our algorithm is adaptive. It is real-time. But it is not AI.

It is sufficiently novel and ‘non-obvious’ though, that we were granted a European Patent for it in 2021.

Here is the reason why:

If you subject an unpainted stone sculpture to light levels of say 500 Lux, it will not suffer noticeable deterioration.

However, if you put a silk antiquity under those same light conditions, it can deteriorate in a matter of days or weeks.

The inventories of museums, auction houses, corporate art collectors or luxury retailers can amount to hundreds of billions of Dollars, so this value is literally being erased by light exposure.

Not all objects are the same though.

For this reason, ArtRatio smart glass vitrines modify their behaviour in real time based on what is being displayed, as well as local environmental variables and visitor engagement.

Some materials can be responsive to light, but others are triggered by temperature or humidity.

Since about 50% of solar radiation is infrared (i.e. heat), incoming sunlight can increase the local temperature inside a display case, which decreases the relative humidity in the enclosed space.

So, you see: light, temperature, humidity and even the electrical conductivity of air are all connected, with the damage being triggered by light.

And since active smart glass is an electrically-controllable light filter, it seems obvious to use it to do just that.

== ArtRatio Case Studies ==

ArtRatio has implemented smart glass display vitrines for museums, private collectors and luxury retailers, including most recently a library in Boston and an exhibition of patrimonial jewellery for a major European luxury house.

Unfortunately, non-disclosure agreements prevent me from saying more, but stay tuned to our social media channels to see photos and videos when the above-mentioned work can be officially revealed.

Our customers include the National Museum of Sweden, Sotheby’s Institute of Art and the Wellcome Trust.

One project which I can discuss is our smart glass wall-hangable display frame which protects the original map of the 1815 Battle of Waterloo at the Royal Engineers Museum in the UK.

=== The Waterloo Map ===

During the course of this project, the museum conservators informed us that the map still had the original pencil markings of the first Duke of Wellington on it (as well as blood from one of the soldiers who was carrying the map on his body when he was killed in battle), so all measures should be taken to avoid damage to these materials.

One measure we took was to control the light exposure, of course, but another was to control the relative humidity inside the frame, giving rise to two benefits:-

1. This minimises any mould or insects from damaging the map, thanks to the microclimate inside the smart frame.

2. The second issue is due to the inherent ability of glass to collect electrostatic charge, which builds up when we rub our slippers on a woollen carpet, for example.

This can result in very high electrostatic voltages accumulating on our bodies, reaching up to 30 kV. Ensuring the humidity remains between a target of 45%-50% stops the air from drying out.

If the humidity falls below that figure, the drier air, containing less water, can prevent the electrostatic charge on highly insulative surfaces (like acrylic and glass) from dissipating naturally to electrical earth.

In the worst case, the resulting electric field can ‘lift off’ friable media on artworks, like chalk, charcoal and graphite (such as the pencil markings of the first Duke of Wellington).

Who would have thought that the electrical conductivity of air can be so directly influenced by a sheet of glass?

In this case, since the smart glass is in very close proximity to a 200 year old original map of iconic importance to British military history, we took great precautions to ensure the smart glass did not damage the fragile pencil markings due to any electrostatic field on the glass interior surface.

You can read more about the Waterloo Map at [https://www.artratio.co.uk/waterloo-map-1815 this link].

Across all our installations, the ArtRatio patented algorithm and cloud-based analytics platform automatically balance the exhibition with the conservation of fragile works of art, allowing our customers to decide whether to display, conserve, store, loan or sell the items.

Our next step, as you can imagine, will be to transition the algorithm to one based on machine learning (AI).

Watch this space for more...

== What does the future hold for smart glass? ==

Our collective journey into adaptive, truly intelligent smart glass building facades, smart glass showcases and smart glass enabled transportation has just begun.

We have merely scratched the surface of the available use cases.

Continued advances in materials and algorithms will benefit sectors where smart glass is already being used; from transportation to retail; from hospitality to heritage to healthcare.

What is exciting is that global initiatives such as sustainability and user privacy are driving us to a future that may be beautifully illuminated by daylight, controlled judiciously by smart glass.

= Author Bio =

Manoj’s first experience with glass goes back to the fabrication of optical waveguides as a final year project at the Optoelectronics Research Centre (Southampton University) in 1989, sponsored by Ferranti Semiconductors in the UK.

Manoj worked initially as a Trainee Patent Agent in London representing semiconductor firms at the UK, European and US patent offices, before embarking on a career as a Software Engineer across telecommunications, automotive, finance and eGovernment sectors.

Manoj founded ArtRatio in 2008 to build smart glass display cases for museums and luxury retailers, and launched SmartGlassWorld thereafter to promote development in smart materials.

Manoj’s experience as a manufacturer of smart glass end-products and as a smart glass distributor & consultant allows for a deep understanding of what customers need in order to achieve a return on investment in smart glass technologies.

Manoj is a UK Chartered Engineer with a Bachelors in Electronics Engineering from Southampton University and a Masters in Software Engineering from Oxford University, and is a guest lecturer on the MA Art Logistics programme at Sotheby's Institute of Art in London.

[[Category:Projects_and_case_studies]] [[Category:Research_/_Innovation]] [[Category:Products_/_components]] [[Category:Conservation]]

Smart glass and artificial intelligence

2022-09-04T19:40:49Z

Smartglassworld:

= Smart Glass & Artificial Intelligence =

Smart Glass is only as smart as the control system that drives it.

Whether it is for viewing the exterior world from within buildings or vehicles, or filtering incoming daylight onto interiors, smart glass systems must now evolve to a position where they are continuously learning from their immediate environment, adapting to changes in local and global events.

For this, the future of smart glass systems must reside with artificial intelligence.

== Let me explain ==

Your smartphone can adjust its behaviour based on your personal data and local events, right?

Examples include :

* dimming down the screen when the battery is low,
* detecting the risk of a heart attack using a medical app, and
* finding the best sushi restaurant, near you, right now.

Similarly, a smart glass system should also be able to adjust its behaviour based on what is happening in its local environment and what it is learning from global events as they unfold in real-time.

== Use Cases ==

We have seen some excellent examples in the news recently from smart glass manufacturers such as View and Halio in which proprietary artificial intelligence (AI) algorithms adapt building facades to changes in sunlight, with clear benefits (pun intended) for sustainability, privacy and comfort.

Let us now consider some more advanced use cases that would take this a step further:-

=== Security Threats in Large Cities ===

Just as car doors unlock automatically on detecting an accident, smart glass facades could also default to a transparent state in emergency situations.

For example, if an AI agent monitoring social media chatter detected an imminent terrorist threat in a large city during a bright sunny day, it is probable that any building with a smart glass facade would be in its energy-filtering ‘dark mode’, to minimise glare and air conditioning costs.

This dark mode however would also impair visibility into the building for law enforcement and security agencies trying to ensure everyone has been evacuated from the building.

In this case, smart glass facades in the immediate vicinity of the security threat could automatically transition to an ‘emergency mode’ in which they are held indefinitely in a transparent state, aiding visual communication.

The same principle could also be applied to smart glass systems installed on transportation, enabling a visual line of communication with passengers trapped after an accident, or when the vehicle predicts the risk of an stranded infant or pet suffering possible dehydration.

=== Theft of High-Value Items ===

Whether in a private residence, a high-end jewellery store or an art gallery, if smart glass is being used on walls or in showcases, and if the AI algorithm monitoring CCTV cameras anticipates an imminent theft, the smart glass system could ‘go dark’, obscuring the items and slowing down the attacker from finding the most valuable pieces.

When the premises are closed, security guards still need to be able to see the displayed items while on patrol. However, if the building security is likely to be breached, the sensible solution would be to hide everything from view. Not just the most valuable items, but everything.

It may not necessarily stop the attacker but it can slow them down, giving security or law enforcement agents extra time to respond.

=== Reducing Light Damage in Museums and Luxury Retail ===

Global art and luxury retail inventories worldwide can amount to Billions of Dollars in assets, but excessive light exposure can cause severe damage to paintings, fashion textiles and even [https://www.artratio.co.uk/protecting-fine-wine-collections-from-light-exposure fine wines], thus hurting their market value.

If the smart glass control system ‘knew’ which materials were on display (and their sensitivity), it could dim the glass down a few notches.

This change in illuminance would be practically imperceptible since the eye is an approximately logarithmic sensor (Weber–Fechner law), but it would substantially reduce the long term damage from light, since light exposure is the time-integral of the light level.

Future smart glass systems should also learn to automatically identify which items are most vulnerable to damage using machine vision, then adjust their behaviour proactively and intelligently to preserve their value.

Let’s now take a step back and break down the basic building blocks to understanding such AI-driven smart glass systems:-

== Firstly, What is Smart Glass? ==

Smart glass is not a product, but rather a family of technologies.

Broadly speaking, this family can be divided into two major groups: ‘passive’ and ‘active’.

In both cases, a stimulus triggers changes in certain properties of smart glass, such as its transmittance, reflectance, refraction (i.e. scattering of light) or even its electrical conductivity.

Passive smart glass reacts to environmental stimuli such as light or temperature. Examples include thermochromic and photochromic smart glass which dim when struck by heat or ultraviolet light (respectively).

Active smart glass, on the other hand, is driven electrically, often by way of sensors or control commands from a building management system (BMS).

Examples of active smart glass technologies include:

* suspended particle devices (SPD-SmartGlass), created by Research Frontiers Inc.
* liquid crystal technology such as Merck Eyrise or Smartglass International (note: when the crystals are dispersed in a polymer film this technology is called ‘PDLC’ smart glass),
* electrochromic glass (examples include View, Halio, SageGlass and Heliotrope) and
* micro-blinds, created by the National Research Council of Canada (NRC).

You can find more on [https://www.smartglassworld.net Smart Glass World], a site we created to educate our customers in smart glass technologies.

Within the active smart glass category we could also reasonably include ‘transparent photovoltaic’ (TPV) glass, which converts part of the electromagnetic spectrum into electricity (albeit not as efficiently as solar cells).

The advantage is that TPV glass is - well - transparent, thus allowing its use as windows in exterior building facades. When incorporated directly into the building facade, it is often referred to as Building-Integrated Photovoltaic (BIPV) glass.

Other materials which can be classified within the ‘smart glass family’ include smart mirrors, augmented-reality spectacles (think Vuzix, RealWear, Google Glass or the much-anticipated new [https://appleinsider.com/inside/apple-glass Apple Glass]) and existing heads-up displays (HUDs) for transportation.

== Where does Artificial Intelligence fit into all this? ==

Artificial intelligence (AI) aims to predict future outcomes based on historical data, rather than relying on pre-programmed rules.

The system is ‘trained’ to recognise patterns, behaviours or properties and, over time, learns what response to execute.

Artificial intelligence (AI) is often seen as an umbrella term, encompassing Machine Learning, which can be specialised to Deep Learning and further specialised to Neural Networks.

For the purposes of this article, we will not delve further into the differences between these sub fields.

Current examples of AI applications include automated stock trading, customer service chatbots, Netflix’s recommendation engine and self-driving cars.

The key aspect of AI systems is that they adapt in real time, as opposed to traditional systems which are pre-programmed to obey a static set of rules.

AI algorithms can drive smart glass facades or products more intelligently, and even preempt certain dangerous or undesirable circumstances.

== Can Smart Glass 'learn'? ==

Smart glass itself is just a material, like concrete, stone or wood, with the key difference being the change in its optical properties when driven by a stimulus, as described above.

However, when coupled with an AI system, the whole ‘smart glass system’ could indeed learn, but this depends on whether there is a dataset to teach the system what is ‘right’ and ‘wrong’.

And this depends on whether there are sufficient real-time sensors recording the events which feed this dataset.

Based on the use cases outlined above, these ‘sensors’ might include:

* bots that monitor social media chatter, alerting law enforcement agencies to increased risks of a threat to the public;
* a computer vision system recognising a known felon in the vicinity of likely targets of theft;
* light exposure monitors that predict an increased risk of damage to light-sensitive materials such as pharmaceutical drugs, phototoxic oils, perfumes and dyes.

== --- FEEL FREE TO EDIT OUT THE FOLLOWING 2 SECTIONS IF YOU FIND IT IS TOO ADVERTORIAL --- ==

== About ArtRatio ==

At ArtRatio, we are not yet using AI but rather a modified version of a PID (Proportional–Integral–Derivative) algorithm, similar to what you would find in a cruise control system in a car.

Our algorithm is adaptive. It is real-time. But it is not AI.

It is sufficiently novel and ‘non-obvious’ though, that we were granted a European Patent for it in 2021.

If you subject an unpainted stone sculpture to light levels of say 500 Lux, it will not suffer noticeable deterioration.

But if you put a silk antiquity under those same light conditions, it can deteriorate in a matter of days or weeks.

The inventories of museums, auction houses, corporate art collectors or luxury retailers can amount to Billions of Dollars, so value is literally being erased by light.

For this reason, ArtRatio smart glass vitrines modify their behaviour in real time based on what is being displayed, as well as local environmental variables and visitor engagement.

Some materials can be responsive to only temperature or humidity, but since about 50% of solar radiation is infrared (i.e. heat), incoming sunlight can increase the local temperature, which decreases the relative humidity in an enclosed space.

So, light, temperature, humidity and even the electrical conductivity of air are all connected, with the damage being triggered by light. And since active smart glass is an electrically-controlled light filter, it seems obvious to use it to do just that.

== ArtRatio Case Studies ==

ArtRatio has implemented smart glass display vitrines for museums, private collectors and luxury retailers, including most recently a private library in Boston and an exhibition of patrimonial jewellery for a major luxury house.

Unfortunately, non-disclosure agreements prevent me from saying more, but stay tuned to our social media channels to see photos and videos when the above-mentioned work can be officially revealed.

Our customers include the National Museum of Sweden, Sotheby’s Institute of Art and the Wellcome Trust.

One project which I can discuss is our smart glass wall-hangable display frame which protects the original map of the 1815 Battle of Waterloo at the Royal Engineers Museum in the UK.

During the course of this project, the museum conservators informed us that the map still has the original pencil markings of the first Duke of Wellington on it (as well as blood from one of the soldiers who was carrying the map on him when he was killed in battle), so all measures should be taken to avoid damage to these materials.

One measure we took was to control the relative humidity inside the frame, which has two benefits:-

1. This minimises any mould or insects from damaging the map thanks to the microclimate inside the frame.

2. The second one is due to the inherent ability of glass to collect electrostatic charge, which builds up, for example, when we rub our slippers on a woollen carpet. This can result in very high electrostatic voltages accumulating on our bodies, reaching up to 30 kV. Ensuring the humidity remains between a target of 45%-50% stops the air from drying out.

If the humidity falls below that figure, the drier air, containing less water, can prevent the electrostatic charge on highly insulative surfaces (like acrylic and glass) from dissipating naturally to electrical earth. In the worst case, the resulting electric field can ‘lift off’ friable media on artworks, like chalk, charcoal and graphite (such as the pencil markings).

Who would have thought that the electrical conductivity of air can be so directly influenced by a sheet of glass?

In this case, since the smart glass is in very close proximity to a 200 year old original map of iconic importance to British military heritage, we took great precautions to ensure the smart glass did not damage the fragile pencil markings due to any electrostatic charge which might be present on the glass interior surface. You can read more about the Waterloo Map at [https://www.artratio.co.uk/waterloo-map-1815 this link].

Across all our installations, the ArtRatio patented algorithm and cloud-based analytics platform automatically balance the exhibition with the conservation of fragile works of art, allowing our customers to decide whether to display, conserve, store, loan or sell the items.

== What does the future hold for smart glass? ==

Our collective journey into adaptive, truly intelligent smart glass building facades, smart glass showcases and smart glass enabled transportation has just begun.

We have merely scratched the surface of the available use cases.

Continued advances in materials and algorithms will benefit sectors where smart glass is already being used; from transportation to retail; from hospitality to heritage to healthcare.

What is exciting is that global initiatives such as sustainability and user privacy are driving us to a future that may be beautifully illuminated by daylight, controlled judiciously by smart glass.

= Author Bio =

Manoj’s first experience with glass goes back to the fabrication of optical waveguides as a final year project at the Optoelectronics Research Centre (Southampton University) in 1989, sponsored by Ferranti Semiconductors in the UK.

Manoj worked initially as a Trainee Patent Agent in London representing semiconductor firms at the UK, European and US patent offices, before embarking on a career as a Software Engineer across telecommunications, automotive, finance and eGovernment sectors.

Manoj founded ArtRatio in 2008 to build smart glass display cases for museums and luxury retailers, and launched SmartGlassWorld thereafter to promote development in smart materials.

Manoj’s experience as a manufacturer of smart glass end-products and as a smart glass distributor & consultant allows for a deep understanding of what customers need in order to achieve a return on investment in smart glass technologies.

Manoj is a UK Chartered Engineer with a Bachelors in Electronics Engineering from Southampton University and a Masters in Software Engineering from Oxford University, and is a guest lecturer on the MA Art Logistics programme at Sotheby's Institute of Art in London.

[[Category:Projects_and_case_studies]] [[Category:Research_/_Innovation]] [[Category:Products_/_components]] [[Category:Conservation]]

Smart glass and artificial intelligence

2022-09-04T19:38:31Z

Smartglassworld:

= Smart Glass & Artificial Intelligence =

Smart Glass is only as smart as the control system that drives it.

Whether it is for viewing the exterior world from within buildings or vehicles, or filtering incoming daylight onto interiors, smart glass systems must now evolve to a position where they are continuously learning from their immediate environment, adapting to changes in local and global events.

For this, the future of smart glass systems must reside with artificial intelligence.

== Let me explain ==

Your smartphone can adjust its behaviour based on your personal data and local events, right?

Examples include :

* dimming down the screen when the battery is low,
* detecting the risk of a heart attack using a medical app, and
* finding the best sushi restaurant, near you, right now.

Similarly, a smart glass system should also be able to adjust its behaviour based on what is happening in its local environment and what it is learning from global events as they unfold in real-time.

== Use Cases ==

We have seen some excellent examples in the news recently from smart glass manufacturers such as View and Halio in which proprietary artificial intelligence (AI) algorithms adapt building facades to changes in sunlight, with clear benefits (pun intended) for sustainability, privacy and comfort.

Let us now consider some more advanced use cases that would take this a step further:-

=== Security Threats in Large Cities ===

Just as car doors unlock automatically on detecting an accident, smart glass facades could also default to a transparent state in emergency situations.

For example, if an AI agent monitoring social media chatter detected an imminent terrorist threat in a large city during a bright sunny day, it is probable that any building with a smart glass facade would be in its energy-filtering ‘dark mode’, to minimise glare and air conditioning costs.

This dark mode however would also impair visibility into the building for law enforcement and security agencies trying to ensure everyone has been evacuated from the building.

In this case, smart glass facades in the immediate vicinity of the security threat could automatically transition to an ‘emergency mode’ in which they are held indefinitely in a transparent state, aiding visual communication.

The same principle could also be applied to smart glass systems installed on transportation, enabling a visual line of communication with passengers trapped after an accident, or when the vehicle predicts the risk of an stranded infant or pet suffering possible dehydration.

=== Theft of High-Value Items ===

Whether in a private residence, a high-end jewellery store or an art gallery, if smart glass is being used on walls or in showcases, and if the AI algorithm monitoring CCTV cameras anticipates an imminent theft, the smart glass system could ‘go dark’, obscuring the items and slowing down the attacker from finding the most valuable pieces.

When the premises are closed, security guards still need to be able to see the displayed items while on patrol. However, if the building security is likely to be breached, the sensible solution would be to hide everything from view. Not just the most valuable items, but everything.

It may not necessarily stop the attacker but it can slow them down, giving security or law enforcement agents extra time to respond.

=== Reducing Light Damage in Museums and Luxury Retail ===

Global art and luxury retail inventories worldwide can amount to Billions of Dollars in assets, but excessive light exposure can cause severe damage to paintings, fashion textiles and even [https://www.artratio.co.uk/protecting-fine-wine-collections-from-light-exposure fine wines], thus hurting their market value.

If the smart glass control system ‘knew’ which materials were on display (and their sensitivity), it could dim the glass down a few notches.

This change in illuminance would be practically imperceptible since the eye is an approximately logarithmic sensor (Weber–Fechner law), but it would substantially reduce the long term damage from light, since light exposure is the time-integral of the light level.

Future smart glass systems should also learn to automatically identify which items are most vulnerable to damage using machine vision, then adjust their behaviour proactively and intelligently to preserve their value.

Let’s now take a step back and break down the basic building blocks to understanding such AI-driven smart glass systems:-

== Firstly, What is Smart Glass? ==

Smart glass is not a product, but rather a family of technologies.

Broadly speaking, this family can be divided into two major groups: ‘passive’ and ‘active’.

In both cases, a stimulus triggers changes in certain properties of smart glass, such as its transmittance, reflectance, refraction (i.e. scattering of light) or even its electrical conductivity.

Passive smart glass reacts to environmental stimuli such as light or temperature. Examples include thermochromic and photochromic smart glass which dim when struck by heat or ultraviolet light (respectively).

Active smart glass, on the other hand, is driven electrically, often by way of sensors or control commands from a building management system (BMS).

Examples of active smart glass technologies include:

* suspended particle devices (SPD-SmartGlass), created by Research Frontiers Inc.
* liquid crystal technology such as Merck Eyrise or Smartglass International (note: when the crystals are dispersed in a polymer film this technology is called ‘PDLC’ smart glass),
* electrochromic glass (examples include View, Halio, SageGlass and Heliotrope) and
* micro-blinds, created by the National Research Council of Canada (NRC).

You can find more on [https://www.smartglassworld.net Smart Glass World], a site we created to educate our customers in smart glass technologies.

Within the active smart glass category we could also reasonably include ‘transparent photovoltaic’ (TPV) glass, which converts part of the electromagnetic spectrum into electricity (albeit not as efficiently as solar cells).

The advantage is that TPV glass is - well - transparent, thus allowing its use as windows in exterior building facades. When incorporated directly into the building facade, it is often referred to as Building-Integrated Photovoltaic (BIPV) glass.

Other materials which can be classified within the ‘smart glass family’ include smart mirrors, augmented-reality spectacles (think Vuzix, RealWear, Google Glass or the much-anticipated new [https://appleinsider.com/inside/apple-glass Apple Glass]) and existing heads-up displays (HUDs) for transportation.

== Where does Artificial Intelligence fit into all this? ==

Artificial intelligence (AI) aims to predict future outcomes based on historical data, rather than relying on pre-programmed rules.

The system is ‘trained’ to recognise patterns, behaviours or properties and, over time, learns what response to execute.

Artificial intelligence (AI) is often seen as an umbrella term, encompassing Machine Learning, which can be specialised to Deep Learning and further specialised to Neural Networks.

For the purposes of this article, we will not delve further into the differences between these sub fields.

Current examples of AI applications include automated stock trading, customer service chatbots, Netflix’s recommendation engine and self-driving cars.

The key aspect of AI systems is that they adapt in real time, as opposed to traditional systems which are pre-programmed to obey a static set of rules.

AI algorithms can drive smart glass facades or products more intelligently, and even preempt certain dangerous or undesirable circumstances.

== Can Smart Glass 'learn'? ==

Smart glass itself is just a material, like concrete, stone or wood, with the key difference being the change in its optical properties when driven by a stimulus, as described above.

However, when coupled with an AI system, the whole ‘smart glass system’ could indeed learn, but this depends on whether there is a dataset to teach the system what is ‘right’ and ‘wrong’.

And this depends on whether there are sufficient real-time sensors recording the events which feed this dataset.

Based on the use cases outlined above, these ‘sensors’ might include:

* bots that monitor social media chatter, alerting law enforcement agencies to increased risks of a threat to the public;
* a computer vision system recognising a known felon in the vicinity of likely targets of theft;
* light exposure monitors that predict an increased risk of damage to light-sensitive materials such as pharmaceutical drugs, phototoxic oils, perfumes and dyes.

== --- FEEL FREE TO EDIT OUT THE FOLLOWING 2 SECTIONS IF YOU FIND IT IS TOO ADVERTORIAL --- ==

== About ArtRatio ==

At ArtRatio, we are not yet using AI but rather a modified version of a PID (Proportional–Integral–Derivative) algorithm, similar to what you would find in a cruise control system in a car.

Our algorithm is adaptive. It is real-time. But it is not AI.

It is sufficiently novel and ‘non-obvious’ though, that we were granted a European Patent for it in 2021.

If you subject an unpainted stone sculpture to light levels of say 500 Lux, it will not suffer noticeable deterioration.

But if you put a silk antiquity under those same light conditions, it can deteriorate in a matter of days or weeks.

The inventories of museums, auction houses, corporate art collectors or luxury retailers can amount to Billions of Dollars, so value is literally being erased by light.

For this reason, ArtRatio smart glass vitrines modify their behaviour in real time based on what is being displayed, as well as local environmental variables and visitor engagement.

Some materials can be responsive to only temperature or humidity, but since about 50% of solar radiation is infrared (i.e. heat), incoming sunlight can increase the local temperature, which decreases the relative humidity in an enclosed space.

So, light, temperature, humidity and even the electrical conductivity of air are all connected, with the damage being triggered by light. And since active smart glass is an electrically-controlled light filter, it seems obvious to use it to do just that.

== ArtRatio Case Studies ==

ArtRatio has implemented smart glass display vitrines for museums, private collectors and luxury retailers, including most recently a private library in Boston and an exhibition of patrimonial jewellery for a major luxury house.

Unfortunately, non-disclosure agreements prevent me from saying more, but stay tuned to our social media channels to see photos and videos when the above-mentioned work can be officially revealed.

Our customers include the National Museum of Sweden, Sotheby’s Institute of Art and the Wellcome Trust.

One project which I can discuss is our smart glass wall-hangable display frame which protects the original map of the 1815 Battle of Waterloo at the Royal Engineers Museum in the UK.

During the course of this project, the museum conservators informed us that the map still has the original pencil markings of the first Duke of Wellington on it (as well as blood from one of the soldiers who was carrying the map on him when he was killed in battle), so all measures should be taken to avoid damage to these materials.

One measure we took was to control the relative humidity inside the frame, which has two benefits:-

1. This minimises any mould or insects from damaging the map thanks to the microclimate inside the frame.

2. The second one is due to the inherent ability of glass to collect electrostatic charge, which builds up, for example, when we rub our slippers on a woollen carpet. This can result in very high electrostatic voltages accumulating on our bodies, reaching up to 30 kV. Ensuring the humidity remains between a target of 45%-50% stops the air from drying out.

If the humidity falls below that figure, the drier air, containing less water, can prevent the electrostatic charge on highly insulative surfaces (like acrylic and glass) from dissipating naturally to electrical earth. In the worst case, the resulting electric field can ‘lift off’ friable media on artworks, like chalk, charcoal and graphite (such as the pencil markings).

Who would have thought that the electrical conductivity of air can be so directly influenced by a sheet of glass?

In this case, since the smart glass is in very close proximity to a 200 year old original map of iconic importance to British military heritage, we took great precautions to ensure the smart glass did not damage the fragile pencil markings due to any electrostatic charge which might be present on the glass interior surface. You can read more about the Waterloo Map at [https://www.artratio.co.uk/waterloo-map-1815 this link].

Across all our installations, the ArtRatio patented algorithm and cloud-based analytics platform automatically balance the exhibition with the conservation of fragile works of art, allowing our customers to decide whether to display, conserve, store, loan or sell the items.

== What does the future hold for smart glass? ==

Our collective journey into adaptive, truly intelligent smart glass building facades, smart glass showcases and smart glass enabled transportation has just begun.

We have merely scratched the surface of the available use cases.

Continued advances in materials and algorithms will benefit sectors where smart glass is already being used; from transportation to retail; from hospitality to heritage to healthcare.

What is exciting is that global initiatives such as sustainability and user privacy are driving us to a future that may be beautifully illuminated by daylight, controlled judiciously by smart glass.

== Author Bio ==

Manoj’s first experience with glass goes back to the fabrication of optical waveguides as a final year project at the Optoelectronics Research Centre (Southampton University) in 1989, sponsored by Ferranti Semiconductors in the UK.

Manoj worked initially as a Trainee Patent Agent in London representing semiconductor firms at the UK, European and US patent offices, before embarking on a career as a Software Engineer across telecommunications, automotive, finance and eGovernment sectors.

Manoj founded ArtRatio in 2008 to build smart glass display cases for museums and luxury retailers, and launched SmartGlassWorld thereafter to promote development in smart materials.

Manoj’s experience as a manufacturer of smart glass end-products and as a smart glass distributor & consultant allows for a deep understanding of what customers need in order to achieve a return on investment in smart glass technologies.

Manoj is a UK Chartered Engineer with a Bachelors in Electronics Engineering from Southampton University and a Masters in Software Engineering from Oxford University, and is a guest lecturer on the MA Art Logistics programme at Sotheby's Institute of Art in London.

[[Category:Projects_and_case_studies]] [[Category:Research_/_Innovation]] [[Category:Products_/_components]] [[Category:Conservation]]

Smart glass and artificial intelligence

2022-09-04T16:20:03Z

Smartglassworld:

= Smart Glass & Artificial Intelligence =

Smart Glass is only as smart as the control system that drives it.

Whether it is for viewing the exterior world from within buildings or vehicles, or filtering incoming daylight onto interiors, smart glass systems will need to evolve to a state where they are continuously learning from their immediate environment in order to do their job better.

== Let me explain ==

Your smartphone can adjust its behaviour based on your personal data and local events, right?

Examples include :

* dimming down the screen when the battery is low,
* detecting the risk of a heart attack using a medical app, and
* finding the best sushi restaurant, near you, right now.

Similarly, a smart glass system should also be able to adjust its behaviour based on what is happening in its local environment and what it is learning from global events as they unfold in real-time.

== Use Cases ==

We have seen some excellent examples in the news recently from smart glass manufacturers such as View and Halio in which proprietary artificial intelligence (AI) algorithms adapt building facades to changes in sunlight, with clear benefits (pun intended) for sustainability, privacy and comfort.

Let us now consider some more advanced use cases that would take this a step further:-

== Security Threats in Large Cities ==

Just as car doors unlock automatically on detecting an accident, smart glass facades could also default to a transparent state in emergency situations.

For example, if an AI agent monitoring social media chatter detected an imminent terrorist threat in a large city during a bright sunny day, it is probable that any building with a smart glass facade would be in its energy-filtering ‘dark mode’, to minimise glare and air conditioning costs.

This dark mode however would also impair visibility into the building for law enforcement and security agencies trying to ensure everyone has been evacuated from the building.

In this case, smart glass facades in the immediate vicinity of the security threat could automatically transition to an ‘emergency mode’ in which they are held indefinitely in a transparent state, aiding visual communication.

The same principle could also be applied to smart glass systems installed on transportation, enabling a visual line of communication with passengers trapped after an accident, or when the vehicle predicts the risk of an stranded infant or pet suffering possible dehydration.

== Theft of High-Value Items ==

Whether in a private residence, a high-end jewellery store or an art gallery, if smart glass is being used on walls or in showcases, and if the AI algorithm monitoring CCTV cameras anticipates an imminent theft, the smart glass system could ‘go dark’, obscuring the items and slowing down the attacker from finding the most valuable pieces.

When the premises are closed, security guards still need to be able to see the displayed items while on patrol. However, if the building security is likely to be breached, the sensible solution would be to hide everything from view. Not just the most valuable items, but everything.

It may not necessarily stop the attacker but it can slow them down, giving security or law enforcement agents extra time to respond.

== Reducing Light Damage in Museums and Luxury Retail ==

Global art and luxury retail inventories worldwide can amount to Billions of Dollars in assets, but excessive light exposure can cause severe damage to paintings, fashion textiles and even [https://www.artratio.co.uk/protecting-fine-wine-collections-from-light-exposure fine wines], thus hurting their market value.

If the smart glass control system ‘knew’ which materials were on display (and their sensitivity), it could dim the glass down a few notches.

This change in illuminance would be practically imperceptible since the eye is an approximately logarithmic sensor (Weber–Fechner law), but it would substantially reduce the long term damage from light, since light exposure is the time-integral of the light level.

Future smart glass systems should also learn to automatically identify which items are most vulnerable to damage using machine vision, then adjust their behaviour proactively and intelligently to preserve their value.

Let’s now take a step back and break down the basic building blocks to understanding such AI-driven smart glass systems:-

== Firstly, What is Smart Glass? ==

Smart glass is not a product, but rather a family of technologies.

Broadly speaking, this family can be divided into two major groups: ‘passive’ and ‘active’.

In both cases, a stimulus triggers changes in certain properties of smart glass, such as its transmittance, reflectance, refraction (i.e. scattering of light) or even its electrical conductivity.

Passive smart glass reacts to environmental stimuli such as light or temperature. Examples include thermochromic and photochromic smart glass which dim when struck by heat or ultraviolet light (respectively).

Active smart glass, on the other hand, is driven electrically, often by way of sensors or control commands from a building management system (BMS).

Examples of active smart glass technologies include:

* suspended particle devices (SPD-SmartGlass), created by Research Frontiers Inc.
* liquid crystal technology such as Merck Eyrise or Smartglass International (note: when the crystals are dispersed in a polymer film this technology is called ‘PDLC’ smart glass),
* electrochromic glass (examples include View, Halio, SageGlass and Heliotrope) and
* micro-blinds, created by the National Research Council of Canada (NRC).

You can find more on [https://www.smartglassworld.net Smart Glass World], a site we created to educate our customers in smart glass technologies.

Within the active smart glass category we could also reasonably include ‘transparent photovoltaic’ (TPV) glass, which converts part of the electromagnetic spectrum into electricity (albeit not as efficiently as solar cells).

The advantage is that TPV glass is - well - transparent, thus allowing its use as windows in exterior building facades. When incorporated directly into the building facade, it is often referred to as Building-Integrated Photovoltaic (BIPV) glass.

Other materials which can be classified within the ‘smart glass family’ include smart mirrors, augmented-reality spectacles (think Vuzix, RealWear, Google Glass or the much-anticipated new [https://appleinsider.com/inside/apple-glass Apple Glass]) and existing heads-up displays (HUDs) for transportation.

== Where does Artificial Intelligence fit into all this? ==

Artificial intelligence (AI) aims to predict future outcomes based on historical data, rather than relying on pre-programmed rules.

The system is ‘trained’ to recognise patterns, behaviours or properties and, over time, learns what response to execute.

Artificial intelligence (AI) is often seen as an umbrella term, encompassing Machine Learning, which can be specialised to Deep Learning and further specialised to Neural Networks.

For the purposes of this article, we will not delve further into the differences between these sub fields.

Current examples of AI applications include automated stock trading, customer service chatbots, Netflix’s recommendation engine and self-driving cars.

The key aspect of AI systems is that they adapt in real time, as opposed to traditional systems which are pre-programmed to obey a static set of rules.

AI algorithms can drive smart glass facades or products more intelligently, and even preempt certain dangerous or undesirable circumstances.

== Can Smart Glass learn? ==

Smart glass itself is just a material, like concrete, stone or wood, with the key difference being the change in its optical properties when driven by a stimulus, as described above.

However, when coupled with an AI system, the whole ‘smart glass system’ could indeed learn, but this depends on whether there is a dataset to teach the system what is ‘right’ and ‘wrong’.

And this depends on whether there are sufficient real-time sensors recording the events which feed this dataset.

Based on the use cases outlined above, these ‘sensors’ might include:

* bots that monitor social media chatter, alerting law enforcement agencies to increased risks of a threat to the public;
* a computer vision system recognising a known felon in the vicinity of likely targets of theft;
* light exposure monitors that predict an increased risk of damage to light-sensitive materials such as pharmaceutical drugs, phototoxic oils, perfumes and dyes.

== --- FEEL FREE TO EDIT OUT THE FOLLOWING 2 SECTIONS IF YOU FIND IT IS TOO ADVERTORIAL --- ==

== About ArtRatio ==

At ArtRatio, we are not yet using AI but rather a modified version of a PID (Proportional–Integral–Derivative) algorithm, similar to what you would find in a cruise control system in a car.

Our algorithm is adaptive. It is real-time. But it is not AI.

It is sufficiently novel and ‘non-obvious’ though, that we were granted a European Patent for it in 2021.

If you subject an unpainted stone sculpture to light levels of say 500 Lux, it will not suffer noticeable deterioration.

But if you put a silk antiquity under those same light conditions, it can deteriorate in a matter of days or weeks.

For this reason, ArtRatio smart glass vitrines modify their behaviour in real time based on what is being displayed, as well as local environmental variables and visitor engagement.

Some materials can be responsive to only temperature or humidity, but since about 50% of solar radiation is infrared (i.e. heat), incoming sunlight can increase the local temperature, which decreases the relative humidity in an enclosed space.

So, light, temperature, humidity and even the electrical conductivity of air are all connected. But the damage is often triggered by light. And since active smart glass is an electrically-controlled light filter, it seems obvious to use it to do just that.

== ArtRatio Case Studies ==

ArtRatio has implemented smart glass display vitrines for museums, private collectors and luxury retailers, including most recently a private library in Boston and an exhibition of patrimonial jewellery for a major luxury house.

Unfortunately, non-disclosure agreements prevent me from saying more right now, but stay tuned to our social media channels to see photos and videos when the above-mentioned work can be officially revealed.

Our customers include the National Museum of Sweden, Sotheby’s Institute of Art and the Wellcome Trust.

One project which I can discuss is our smart glass wall-hangable display frame which protects the original map of the 1815 Battle of Waterloo at the Royal Engineers Museum in the UK.

During the course of this project, the museum conservators informed us that the map still has the original pencil markings of the first Duke of Wellington on it (as well as blood from one of the soldiers who was carrying the map on him when he was killed in battle), so all measures should be taken to avoid damage to these materials.

One measure we took was to control the relative humidity inside the frame, which has two benefits:-

1. This minimises any mould or insects from damaging the map thanks to the microclimate inside the frame.

2. The second one is due to the inherent ability of glass to collect electrostatic charge, which builds up, for example, when we rub our slippers on a woollen carpet. This can result in very high electrostatic voltages accumulating on our bodies, reaching up to 30 kV. Ensuring the humidity remains between a target of 45%-50% stops the air from drying out. If the humidity falls below that figure however, the drier air, containing less water, can prevent the electrostatic charge on highly insulative surfaces (like acrylic and glass) from dissipating naturally to electrical earth. In the worst case, the resulting electric field can ‘lift off’ friable media on artworks, like chalk, charcoal and graphite (such as the pencil markings). Who would have thought that the electrical conductivity of air can be so directly influenced by a sheet of glass? By the way, we also recommended using antistatic wipes to increase the conductivity on the interior glass surface.

In this case, since the smart glass was in very close proximity to a 200 year old original map, of iconic importance to British military heritage, we took great precautions to ensure the smart glass did not damage the fragile pencil markings due to any electrostatic charge which might be present on the glass interior surface. You can read more about the Waterloo Map at [https://www.artratio.co.uk/waterloo-map-1815 this link].

Across all our installations, the ArtRatio patented algorithm and cloud-based analytics platform automatically balance the exhibition with the conservation of fragile works of art, allowing our customers to decide whether to display, conserve, store, loan or sell the items.

== What does the future hold for smart glass? ==

Our journey into adaptive, truly intelligent smart glass building facades, smart glass showcases and smart glass enabled transportation has just begun. We have merely scratched the surface of the available use cases.

Continued advances in materials and algorithms will benefit sectors where smart glass is already being used; from transportation to retail; from hospitality to heritage to healthcare.

What is exciting is that global initiatives such as sustainability and user privacy are driving us to a future that will be beautifully illuminated by smart glass.

== Author Bio ==

Manoj’s first experience with glass goes back to the fabrication of optical waveguides as a final year project at the Optoelectronics Research Centre (Southampton University) in 1989.

A sponsored student with Ferranti Semiconductors in the UK, Manoj worked initially as a Trainee Patent Agent in London, representing semiconductor firms at the UK, European and US patent offices, before embarking on a career as a Software Engineer across telecommunications, automotive and eGovernment sectors.

Manoj founded ArtRatio in 2008 to build smart glass display cases for museums and luxury retailers, and launched SmartGlassWorld thereafter to promote development in smart materials.

Manoj’s experience as a manufacturer of smart glass end-products and as a smart glass distributor & consultant allows for a deep understanding of what customers need in order to achieve a return on investment in smart glass technologies.

Manoj is a UK Chartered Engineer with a Bachelors in Electronics Engineering from Southampton University and a Masters in Software Engineering from Oxford University and is a guest lecturer on the MA Art Logistics programme at Sotheby's Institute of Art in London.

[[Category:Projects_and_case_studies]] [[Category:Research_/_Innovation]] [[Category:Products_/_components]] [[Category:Conservation]]

Smart glass and artificial intelligence

2022-09-04T16:15:52Z

Smartglassworld:

= Smart Glass & Artificial Intelligence =

Smart Glass is only as smart as the control system that drives it.

Whether it is for viewing the exterior world from within buildings or vehicles, or filtering incoming daylight onto interiors, smart glass systems will need to evolve to a state where they are continuously learning from their immediate environment in order to do their job better.

== Let me explain ==

Your smartphone can adjust its behaviour based on your personal data and local events, right?

Examples include :

* dimming down the screen when the battery is low,
* detecting the risk of a heart attack using a medical app, and
* finding the best sushi restaurant, near you, right now.

Similarly, a smart glass system should also be able to adjust its behaviour based on what is happening in its local environment and what it is learning from global events as they unfold in real-time.

== Use Cases ==

We have seen some excellent examples in the news recently from smart glass manufacturers such as View and Halio in which proprietary artificial intelligence (AI) algorithms adapt building facades to changes in sunlight, with clear benefits (pun intended) for sustainability, privacy and comfort.

Let us now consider some more advanced use cases that would take this a step further:-

== Security Threats in Large Cities ==

Just as car doors unlock automatically on detecting an accident, smart glass facades could also default to a transparent state in emergency situations.

For example, if an AI agent monitoring social media chatter detected an imminent terrorist threat in a large city during a bright sunny day, it is probable that any building with a smart glass facade would be in its energy-filtering ‘dark mode’, to minimise glare and air conditioning costs.

This dark mode however would also impair visibility into the building for law enforcement and security agencies trying to ensure everyone has been evacuated from the building.

In this case, smart glass facades in the immediate vicinity of the security threat could automatically transition to an ‘emergency mode’ in which they are held indefinitely in a transparent state, aiding visual communication.

The same principle could also be applied to smart glass systems installed on transportation, enabling a visual line of communication with passengers trapped after an accident, or when the vehicle predicts the risk of an stranded infant or pet suffering possible dehydration.

== Theft of High-Value Items ==

Whether in a private residence, a high-end jewellery store or an art gallery, if smart glass is being used on walls or in showcases, and if the AI algorithm monitoring CCTV cameras anticipates an imminent theft, the smart glass system could ‘go dark’, obscuring the items and slowing down the attacker from finding the most valuable pieces.

When the premises are closed, security guards still need to be able to see the displayed items while on patrol. However, if the building security is likely to be breached, the sensible solution would be to hide everything from view. Not just the most valuable items, but everything.

It may not necessarily stop the attacker but it can slow them down, giving security or law enforcement agents extra time to respond.

== Reducing Light Damage in Museums and Luxury Retail ==

Global art and luxury retail inventories worldwide can amount to Billions of Dollars in assets, but excessive light exposure can cause severe damage to paintings, fashion textiles and even [https://www.artratio.co.uk/protecting-fine-wine-collections-from-light-exposure fine wines], thus hurting their market value.

If the smart glass control system ‘knew’ which materials were on display (and their sensitivity), it could dim the glass down a few notches.

This change in illuminance would be practically imperceptible since the eye is an approximately logarithmic sensor (Weber–Fechner law), but it would substantially reduce the long term damage from light, since light exposure is the time-integral of the light level.

Future smart glass systems should also learn to automatically identify which items are most vulnerable to damage using machine vision, then adjust their behaviour proactively and intelligently to preserve their value.

Let’s now take a step back and break down the basic building blocks to understanding such AI-driven smart glass systems:-

== Firstly, What is Smart Glass? ==

Smart glass is not a product, but rather a family of technologies.

Broadly speaking, this family can be divided into two major groups: ‘passive’ and ‘active’.

In both cases, a stimulus triggers changes in certain properties of smart glass, such as its transmittance, reflectance, refraction (i.e. scattering of light) or even its electrical conductivity.

Passive smart glass reacts to environmental stimuli such as light or temperature. Examples include thermochromic and photochromic smart glass which dim when struck by heat or ultraviolet light (respectively).

Active smart glass, on the other hand, is driven electrically, often by way of sensors or control commands from a building management system (BMS).

Examples of active smart glass technologies include:

* suspended particle devices (SPD-SmartGlass), created by Research Frontiers Inc.
* liquid crystal technology such as Merck Eyrise or Smartglass International (note: when the crystals are dispersed in a polymer film this technology is called ‘PDLC’ smart glass),
* electrochromic glass (examples include View, Halio, SageGlass and Heliotrope) and
* micro-blinds, created by the National Research Council of Canada (NRC).

You can find more on [https://www.smartglassworld.net Smart Glass World], a site we created to educate our customers in smart glass technologies.

Within the active smart glass category we could also reasonably include ‘transparent photovoltaic’ (TPV) glass, which converts part of the electromagnetic spectrum into electricity (albeit not as efficiently as solar cells).

The advantage is that TPV glass is - well - transparent, thus allowing its use as windows in exterior building facades. When incorporated directly into the building facade, it is often referred to as Building-Integrated Photovoltaic (BIPV) glass.

Other materials which can be classified within the ‘smart glass family’ include smart mirrors, augmented-reality spectacles (think Vuzix, RealWear, Google Glass or the much-anticipated new [https://appleinsider.com/inside/apple-glass Apple Glass]) and existing heads-up displays (HUDs) for transportation.

== Where does Artificial Intelligence fit into all this? ==

Artificial intelligence (AI) aims to predict future outcomes based on historical data, rather than relying on pre-programmed rules.

The system is ‘trained’ to recognise patterns, behaviours or properties and, over time, learns what response to execute.

Artificial intelligence (AI) is often seen as an umbrella term, encompassing Machine Learning, which can be specialised to Deep Learning and further specialised to Neural Networks.

For the purposes of this article, we will not delve further into the differences between these sub fields.

Current examples of AI applications include automated stock trading, customer service chatbots, Netflix’s recommendation engine and self-driving cars.

The key aspect of AI systems is that they adapt in real time, as opposed to traditional systems which are pre-programmed to obey a static set of rules.

AI algorithms can drive smart glass facades or products more intelligently, and even preempt certain dangerous or undesirable circumstances.

== Can Smart Glass learn? ==

Smart glass itself is just a material, like concrete, stone or wood, with the key difference being the change in its optical properties when driven by a stimulus, as described above.

However, when coupled with an AI system, the whole ‘smart glass system’ could indeed learn, but this depends on whether there is a dataset to teach the system what is ‘right’ and ‘wrong’.

And this depends on whether there are sufficient real-time sensors recording the events which feed this dataset.

Based on the use cases outlined above, these ‘sensors’ might include:

* bots that monitor social media chatter, alerting law enforcement agencies to increased risks of a threat to the public;
* a computer vision system recognising a known felon in the vicinity of likely targets of theft;
* light exposure monitors that predict an increased risk of damage to light-sensitive materials such as pharmaceutical drugs, phototoxic oils, perfumes and dyes.

== --- FEEL FREE TO EDIT OUT THE FOLLOWING 2 SECTIONS IF YOU FIND IT IS TOO ADVERTORIAL --- ==

== About ArtRatio ==

At ArtRatio, we are not yet using AI but rather a modified version of a PID (Proportional–Integral–Derivative) algorithm, similar to what you would find in a cruise control system in a car.

Our algorithm is adaptive. It is real-time. But it is not AI.

It is sufficiently novel and ‘non-obvious’ though, that we were granted a European Patent for it in 2021.

If you subject an unpainted stone sculpture to light levels of say 500 Lux, it will not suffer noticeable deterioration.

But if you put a silk antiquity under those same light conditions, it can deteriorate in a matter of days or weeks.

For this reason, ArtRatio smart glass vitrines modify their behaviour in real time based on what is being displayed, as well as local environmental variables and visitor engagement.

Some materials can be responsive to only temperature or humidity, but since about 50% of solar radiation is infrared (i.e. heat), incoming sunlight can increase the local temperature, which decreases the relative humidity in an enclosed space.

So, light, temperature, humidity and even the electrical conductivity of air are all connected. But the damage is often triggered by light. And since active smart glass is an electrically-controlled light filter, it seems obvious to use it to do just that.

== ArtRatio Case Studies ==

ArtRatio has implemented smart glass display vitrines for museums, private collectors and luxury retailers, including most recently a private library in Boston and an exhibition of patrimonial jewellery for a major luxury house, which is due to take place this year.

Unfortunately, non-disclosure agreements prevent me from saying more right now, but stay tuned to our social media channels to see photos and videos when the above-mentioned work can be officially revealed.

Our customers include the National Museum of Sweden, Sotheby’s Institute of Art and the Wellcome Trust.

One project which I can discuss is our smart glass wall-hangable display frame which protects the original map of the 1815 Battle of Waterloo at the Royal Engineers Museum in the UK.

During the course of this project, the museum conservators informed us that the map still has the original pencil markings of the first Duke of Wellington on it (as well as blood from one of the soldiers who was carrying the map on him when he was killed in battle), so all measures should be taken to avoid damage to these materials.

One measure we took was to control the relative humidity inside the frame, which has two benefits:-

1. This minimises any mould or insects from damaging the map thanks to the microclimate inside the frame.

2. The second one is due to the inherent ability of glass to collect electrostatic charge, which builds up, for example, when we rub our slippers on a woollen carpet. This can result in very high electrostatic voltages accumulating on our bodies, reaching up to 30 kV. Ensuring the humidity remains between a target of 45%-50% stops the air from drying out. If the humidity falls below that figure however, the drier air, containing less water, can prevent the electrostatic charge on highly insulative surfaces (like acrylic and glass) from dissipating naturally to electrical earth. In the worst case, the resulting electric field can ‘lift off’ friable media on artworks, like chalk, charcoal and graphite (such as the pencil markings). Who would have thought that the electrical conductivity of air can be so directly influenced by a sheet of glass? By the way, we also recommended using antistatic wipes to increase the conductivity on the interior glass surface.

In this case, since the smart glass was in very close proximity to a 200 year old original map, of iconic importance to British military heritage, we took great precautions to ensure the smart glass did not damage the fragile pencil markings due to any electrostatic charge which might be present on the glass interior surface. You can read more about the Waterloo Map at [https://www.artratio.co.uk/waterloo-map-1815 this link].

Across all our installations, the ArtRatio patented algorithm and cloud-based analytics platform automatically balance the exhibition with the conservation of fragile works of art, allowing our customers to decide whether to display, conserve, store, loan or sell the items.

== What does the future hold for smart glass? ==

Our journey into adaptive, truly intelligent smart glass building facades, smart glass showcases and smart glass enabled transportation has just begun. We have merely scratched the surface of the available use cases.

Continued advances in materials and algorithms will benefit sectors where smart glass is already being used; from transportation to retail; from hospitality to heritage to healthcare.

What is exciting is that global initiatives such as sustainability and user privacy are driving us to a future that will be beautifully illuminated by smart glass.

== Author Bio ==

[[File:ManojPhatak-Pro-small.jpg]]

Manoj’s first experience with glass goes back to the fabrication of optical waveguides as a final year project at the Optoelectronics Research Centre (Southampton University) in 1989.

A sponsored student with Ferranti Semiconductors in the UK, Manoj worked initially as a Trainee Patent Agent in London, representing semiconductor firms at the UK, European and US patent offices, before embarking on a career as a Software Engineer across telecommunications, automotive and eGovernment sectors.

Manoj founded ArtRatio in 2008 to build smart glass display cases for museums and luxury retailers, and launched SmartGlassWorld thereafter to promote development in smart materials.

Manoj’s experience as a manufacturer of smart glass end-products and as a smart glass distributor & consultant allows for a deep understanding of what customers need in order to achieve a return on investment in smart glass technologies.

Manoj is a UK Chartered Engineer with a Bachelors in Electronics Engineering from Southampton University and a Masters in Software Engineering from Oxford University.

Manoj is a guest lecturer on the MA Fine Art Logistics programme at Sotheby's Institute of Art in London.

[[Category:Projects_and_case_studies]] [[Category:Research_/_Innovation]] [[Category:Products_/_components]] [[Category:Conservation]]

File:ManojPhatak-Pro-small.jpg

2022-09-04T16:12:58Z

Smartglassworld: Manoj Phatak Headshot

Manoj Phatak Headshot