It has, for various reasons, been a while since the last entry on this blog. I was planning to compensate a bit for the delay with a deep dive into the technology behind carbon capture and storage, but then I saw video of a walking piece of plastic on the website of Sweden's public service tv channel, SVT. Apparently the plastic material is of a type that normally bends when heated, but according to the video and article scientists have "taught" the material to instead react to light. It can therefore drag itself forwards like an inchworm if it is periodically illuminated.
So how exactly do you teach a piece of plastic to react to light?
The research behind this thing has also been presented in a paper in the journal Matter, a paper that fortunately is freely available (kudos!). According to the paper the piece of plastic in question is something called a liquid crystal polymer network. Polymers are long molecules consisting of smaller, identical pieces repeating in a long chain - cellulose for instance is a polymer consisting of long chains of identical glucose molecules. Plastics are generally polymers, like polyethene (chains of ethene molecules) or polystyrene (chains of styrene molecules - "poly" here just means "multiple" or "many").
Liquid crystals are also long molecules, some of them are in fact also polymers. The unique thing about them is that they behave partly like liquids, in that they flow between containers and change shape to fill the container, and partly like (what physicists mean when they talk about) crystals, in that the molecules arrange themselves in regular repeating patterns. Liquid crystals have a whole bunch of fascinating properties, in fact the last post on this blog was about their optical properties and what they could mean for lidars.
There are multiple earlier studies showing how you can connect a network of polymer molecules, which gives rigidity and structure to the final material, with liquid crystals (for instance there is this review article, although it's fairly technical). This can for example give you materials that bend in a specific way when heated, like the walking plastic does. The reason is that when the otherwise so well-ordered liquid crystal molecules are heated they move from their well-ordered positions to something more disorderly. If they would start out lying after one another in a long line, increased disorder would mean the line would start to bend and therefore cover a smaller distance. This part of the material would then contract. On the other hand, if the liquid crystal molecules are lying parallel to each other increased disorder may require them to move apart, so this part of the material will expand. In the walking piece of plastic one side has the liquid crystal molecules arranged in lines, while the other has them more or less parallel, so when the material is heated one side will contract and the other will expand. This leads to the material bending significantly when heated
We thus start out with a plastic materal that bends in a very specific way when it is heated. But how has it been made to react to light as well? The paper reveals that one side of the material was coated with a dye that absorbs light in a certain range of wavelengths. The absorbed light causes the dye to heat up and transfer heat to the surroundings, in this case the plastic. However, when it is just in a layer on the surface of the plastic it does not cause a temperature increase large enough to get the plastic to bend. Instead, the material was exposed to both light and heat at the same time. The heat lead both to the plastic bending and to the dye diffusing into the plastic (like the red pigment in tomato sauce spreading into the plastic of your leftover containers - if you use a plastic containers, that is). The more the dye diffused and spread into the plastic, the more efficiently it contributed to heating the plastic, further increasing the temperature. Once the dye was spread more or less evenly throughout the plastic, heating via the dye was efficient enought that once the material was cooled down and straightened out, shining a light on it caused enough of a temperature increase for it to bend again.
So does this mean that the piece of plastic has been taught something? The scientists themselves compare the process to conditioning and draw parallels to Pavlov's experiments on dogs. Pavlov's experiments showed that the dogs, who normally started to drool when given food, could also be made to drool at the sound of a bell, provided that they were first conditioned by hearing the bell while they were being fed. The scientists compare the heat that causes the plastic to bend to the food, the light to the bell and the simultaneous exposure to light and heat to the conditioning phase.
They also admit that there are problems with this comparison and that the plastic is (obviously) a much simpler system. An important difference is that Pavlov's dogs reacted also without any food being present, while the plastic isn't actually bending in the absence of heat - the heat is just provided in a different way. Another difference is that the piece of plastic cannot spontaneously "forget" its "conditioning" the way a living organism would - the dye will stay where it is. One could also have skipped the "conditioning" altogether and just mixed in the dye from the start, or exposed the material to only heat (rather than heat and light) to get the dye into the plastic, and achieved the same end result. All things considered, it is doubtful whether this should really be seen as a form of conditioning, and thereby learning. Maybe this research will give rise to a simple material model for some kinds of learning, but it is clearly very far from the kinds of learning seen in organisms.
Sunday, December 22, 2019
Tuesday, July 16, 2019
Why put liquid crystals in LiDARs?
When trying to develop self-driving cars, companies have equipped their test and demo vehicles with a large number of sensors of various kinds. One popular type of sensor is the LiDAR, a device that sends out narrow pulses of laser light and measures the time it takes for the light to be reflected by something in the surroundings and come back. From information about the elapsed time and the direction of the laser it is easy to determine the location of the point where the pulse was reflected. If you then sweep the beam over an area you will get a series of measurements giving the nearest distance to an object at each angle. Of course this only covers two dimensions, so several lasers are mounted on top of each other in order to get a three-dimensional map of the surroundings. A LiDAR can produce a relatively high resolution mapping even at large distances, say a few hundred meters, so it is not surprising that they are popular among people who are trying to supply self-driving algorithms with sufficient amounts of high-quality data.
* I must admit that I am guessing a bit here, since there are many recent patent applications for similar ideas and I have not been able to find exactly which ones belong or are licensed to Lumotive. The one that seems most likely to form the basis of Lumotive's work is WO2018156688A1, which has the Lumotive CTO listed as an inventor.
On the other hand there are also companies, notably Elon Musk's Tesla, that prefer not to use LiDAR. The technology has a number of drawbacks, such as that every single LiDAR is very expensive and that they are prone to breaking often due to having many moving parts. The LiDARs from Velodyne simply have narrow-beam lasers that rotate 360 degrees, other companies use mirrors and microelectromechanical systems to scan laser beams over a smaller field of view, but they all seem to need moving parts, which tend to wear out quickly.
In March this year, however, the American company Lumotive claimed to have come up with a way to dispense with the moving parts completely. According to IEEE Spectrum, they accomplish this by using a liquid crystal metamaterial to slow down selected parts of the laser beam, thereby shifting its phase relative to the other parts. This means that the peaks and troughs of the electromagnetic wave in different parts of the beam will occur in different places, reinforcing each other in some directions while cancelling each other out in others. By controlling how much which parts of the beam are slowed down it is possible to control the direction of the beam (incidentally, this is what I tried to describe in my post about radar and the spinning thing, except now it's with infrared light instead of microwaves).
If this turns out to work well it would be extremely useful, but what exactly is a liquid crystal metamaterial? We know that a metamaterial is an artificial material that is constructed out of small bits of other materials, usually in a way that gives it very exotic properties. So apparently, we are dealing with an artificial material made with liquid crystals.
Liquid crystals are substances, usually consisting of very long molecules, that in some ways behave like liquids and in other ways like crystals. (This is "crystal" in the scientific sense, meaning that atoms are arranged in a regular three-dimensional grid.) For example, liquid crystals will often flow and change shape like liquids but the molecules will be arranged in a regular, crystal-like structure. Both Lumotive's LiDAR and the more well known application of liquid crystals, namely liquid crystal displays (LCD), make use of the ease with which the molecular orientation in the liquid crystal can be changed (because it is a liquid) in combination with the special optical properties that arise from the crystalline structure.
Since liquid crystals consist of long molecules they tend to be very anisotropic, meaning that the properties of the material are different depending on if you look at it along the length axis of the molecules, perpendicular to it, or from some other angle. When it comes to optical properties this means that the speed of light propagation in the liquid crystal, and therefore the refractive index, is different if the light is propagating along the molecules or across them. The effect also depends on the relation between the molecule orientation and the polarization of the light, in a way that makes liquid crystals able to change the polarization of light that passes through them.
Liquid crystals are substances, usually consisting of very long molecules, that in some ways behave like liquids and in other ways like crystals. (This is "crystal" in the scientific sense, meaning that atoms are arranged in a regular three-dimensional grid.) For example, liquid crystals will often flow and change shape like liquids but the molecules will be arranged in a regular, crystal-like structure. Both Lumotive's LiDAR and the more well known application of liquid crystals, namely liquid crystal displays (LCD), make use of the ease with which the molecular orientation in the liquid crystal can be changed (because it is a liquid) in combination with the special optical properties that arise from the crystalline structure.
Since liquid crystals consist of long molecules they tend to be very anisotropic, meaning that the properties of the material are different depending on if you look at it along the length axis of the molecules, perpendicular to it, or from some other angle. When it comes to optical properties this means that the speed of light propagation in the liquid crystal, and therefore the refractive index, is different if the light is propagating along the molecules or across them. The effect also depends on the relation between the molecule orientation and the polarization of the light, in a way that makes liquid crystals able to change the polarization of light that passes through them.
This ability to change the polarization of light is what is used in LCDs. The effects on polarization is dependent on the orientation of the long molecules of the liquid crystal, which can be changed by applying an electric field. By sandwiching a liquid crystal between polarization filters and manipulating the molecular orientation it is possible to turn transmission of light through the structure on, by ensuring that the polarization of the light is aligned with both polarization filters, or off, by ensuring that the polarization of the light is perpendicular to one of the filters. This is the basics of LCD display pixels.
The metamaterials in the Lumotive LiDARs, on the other hand, appear to make use of the anisotropy of the refractive index of liquid crystals*. Just like in LCDs the orientation of the molecules of the liquid crystal is controlled through application of an electric field, but in order to tune the refractive index to a specific value instead of achieving a shift in polarization. This can be seen as choosing if the light will propagate along the molecules, perpendicular to the molecules or at some angle in between, and making use of the difference in propagation speed for the different cases.
The other parts of the metamaterial appear to be dielectric resonators consisting of silicon elements with the liquid crystal material sandwiched in between. When the refractive index of the liquid crystal is changed, this changes the properties of the dielectric resonator as a whole. If a laser beam is reflected from a surface full of these dielectric resonators, the phase of each part of the reflected beam will depend on the refractive index of the liquid crystal in the resonators. By changing the refractive index according to some pattern, the direction of the reflected beam can be controlled.
If this idea turns out to work well in practice it could potentially make LiDARs much more affordable, and therefore probably much more common in vehicles. How much further along the path towards autonomous driving it can take us of course remains to be seen.
The metamaterials in the Lumotive LiDARs, on the other hand, appear to make use of the anisotropy of the refractive index of liquid crystals*. Just like in LCDs the orientation of the molecules of the liquid crystal is controlled through application of an electric field, but in order to tune the refractive index to a specific value instead of achieving a shift in polarization. This can be seen as choosing if the light will propagate along the molecules, perpendicular to the molecules or at some angle in between, and making use of the difference in propagation speed for the different cases.
The other parts of the metamaterial appear to be dielectric resonators consisting of silicon elements with the liquid crystal material sandwiched in between. When the refractive index of the liquid crystal is changed, this changes the properties of the dielectric resonator as a whole. If a laser beam is reflected from a surface full of these dielectric resonators, the phase of each part of the reflected beam will depend on the refractive index of the liquid crystal in the resonators. By changing the refractive index according to some pattern, the direction of the reflected beam can be controlled.
If this idea turns out to work well in practice it could potentially make LiDARs much more affordable, and therefore probably much more common in vehicles. How much further along the path towards autonomous driving it can take us of course remains to be seen.
* I must admit that I am guessing a bit here, since there are many recent patent applications for similar ideas and I have not been able to find exactly which ones belong or are licensed to Lumotive. The one that seems most likely to form the basis of Lumotive's work is WO2018156688A1, which has the Lumotive CTO listed as an inventor.
Sunday, June 2, 2019
More on machine learning and materials
In the last post, I looked at a paper in which machine learning had been used to predict properties of doped graphene. One of my thoughts on this was that the study seemed unsatisfying because it only concluded that the neural network could be trained to make the prediction, but there was no attempt to figure out how it made the prediction - even though that might have told us something interesting both about the network and about doped graphene.
Oddly enough the paper contained references to an interesting study where researchers have done exactly that, albeit for a very different problem. This paper by Ziletti et al, published in Nature Communications in 2018, considers the problem of finding a method to classify crystal structures that is robust and not dependent on a myriad of hand-tuned thresholds and parameters. Along the way they adapt a method for probing the internal workings of the neural network to their own application.
Admittedly, crystal structure classification doesn't sound like the most exciting problem in the world, but within materials science and condensed matter physics it is very important. A lot of materials are crystalline, i.e. they consist of periodically repeating arrangements of atoms. Knowing what these periodically repeating arrangements look like and in what ways they are symmetric is important for understanding, investigating and modelling the material - and often for figuring out what it can be useful for or how it can be improved. It is also a rather tedious process with a lot of potential for error due to noisy measurements and the fact that real-world materials are not perfect crystals, but will always contain defects of various kinds. In the study, the aim is to develop a robust classification method that can handle the presence of defects without misclassifying the structures.
The first step is to decide what sort of input data to use. This is more complex than it seems, since just using atomic positions might make the classifier inherently sensitive to defects. Instead, the researchers have chosen to use simulated diffraction patterns, which condense the information about atom placements and inter-atomic distances to a number of bright spots. (If you recall being shown diffraction in some high-school physics class, this is the same thing only with periodic atomic structures instead of the slits and using electromagnetic radiation with much shorter wavelenght). The diffraction patterns are fed into a convolutional neural networks with multiple layers, which extracts features from the patterns and then classifies the patterns based on these features. Tests of the networks show good performance, even when the data was noisy or the structures contained a high number of defects.
Now for the interesting part. As described in the previous post, feature extraction in a convolutional neural network can be likened to a process where small sections of an image are compared to a smaller image, and a positive response is given if they match. The output of the first comparison is then used in another comparison that extracts more complicated features, and so on. Training of the neural network amounts to adjusting the smaller images, or filters, to respond to features of the image that enable the network to make the correct classification. If picking out straight lines enable correct classification, at least some of the filters will end up responding to straight lines. If curves are important, some of the filters will respond to curves.
This also means that when the neural network has been trained and an image is fed into it, at some deep level in the neural network there will be a vector representing the features that are present in the image and that the neural network has been trained to extract and classify. This vector could tell us exactly what information the network is using when classifying a particular image, but due to the complexity of the preceding layers of the network it is hard to interpret. It is, however, possible to start from this representation of the extracted features and essentially go through all the layers of the network in reverse, finally arriving at a generated picture that shows just the features picked out by the network in a way that can easily be recognized by humans (these pictures are also known as attentive response maps). Using this method, the researchers found that the neural network had in fact learned to use many of the characteristics that humans use when classifying crystal structures, such as distances between atomic planes.
So why is this interesting? For one thing, it demonstrates a method of checking if the classification performed by the network is based on something we would consider significant, or if it has learned to classify based on something obviously irrelevant - say, some kind of noise that is more common in some types of images than others. It also suggests that we could use neural networks not just to make predictions or classify data points, but also to understand the differences between the data points better. It is after all entirely possible that the networks could extract some feature that we do not realize the importance of yet. Personally, I think this is the way to use machine learning in physics - not just looking for the how, but also the why.
Finally, I should mention that the method in itself is adapted from a 2018 paper on classifying X-ray images of body parts, which in turn references a much earlier paper on understanding how convolutional networks classify more ordinary images. It is perhaps telling that it was picked up in the medical field, since knowing that neural networks classify based on the right information could be vital there.
Oddly enough the paper contained references to an interesting study where researchers have done exactly that, albeit for a very different problem. This paper by Ziletti et al, published in Nature Communications in 2018, considers the problem of finding a method to classify crystal structures that is robust and not dependent on a myriad of hand-tuned thresholds and parameters. Along the way they adapt a method for probing the internal workings of the neural network to their own application.
Admittedly, crystal structure classification doesn't sound like the most exciting problem in the world, but within materials science and condensed matter physics it is very important. A lot of materials are crystalline, i.e. they consist of periodically repeating arrangements of atoms. Knowing what these periodically repeating arrangements look like and in what ways they are symmetric is important for understanding, investigating and modelling the material - and often for figuring out what it can be useful for or how it can be improved. It is also a rather tedious process with a lot of potential for error due to noisy measurements and the fact that real-world materials are not perfect crystals, but will always contain defects of various kinds. In the study, the aim is to develop a robust classification method that can handle the presence of defects without misclassifying the structures.
The first step is to decide what sort of input data to use. This is more complex than it seems, since just using atomic positions might make the classifier inherently sensitive to defects. Instead, the researchers have chosen to use simulated diffraction patterns, which condense the information about atom placements and inter-atomic distances to a number of bright spots. (If you recall being shown diffraction in some high-school physics class, this is the same thing only with periodic atomic structures instead of the slits and using electromagnetic radiation with much shorter wavelenght). The diffraction patterns are fed into a convolutional neural networks with multiple layers, which extracts features from the patterns and then classifies the patterns based on these features. Tests of the networks show good performance, even when the data was noisy or the structures contained a high number of defects.
Now for the interesting part. As described in the previous post, feature extraction in a convolutional neural network can be likened to a process where small sections of an image are compared to a smaller image, and a positive response is given if they match. The output of the first comparison is then used in another comparison that extracts more complicated features, and so on. Training of the neural network amounts to adjusting the smaller images, or filters, to respond to features of the image that enable the network to make the correct classification. If picking out straight lines enable correct classification, at least some of the filters will end up responding to straight lines. If curves are important, some of the filters will respond to curves.
This also means that when the neural network has been trained and an image is fed into it, at some deep level in the neural network there will be a vector representing the features that are present in the image and that the neural network has been trained to extract and classify. This vector could tell us exactly what information the network is using when classifying a particular image, but due to the complexity of the preceding layers of the network it is hard to interpret. It is, however, possible to start from this representation of the extracted features and essentially go through all the layers of the network in reverse, finally arriving at a generated picture that shows just the features picked out by the network in a way that can easily be recognized by humans (these pictures are also known as attentive response maps). Using this method, the researchers found that the neural network had in fact learned to use many of the characteristics that humans use when classifying crystal structures, such as distances between atomic planes.
So why is this interesting? For one thing, it demonstrates a method of checking if the classification performed by the network is based on something we would consider significant, or if it has learned to classify based on something obviously irrelevant - say, some kind of noise that is more common in some types of images than others. It also suggests that we could use neural networks not just to make predictions or classify data points, but also to understand the differences between the data points better. It is after all entirely possible that the networks could extract some feature that we do not realize the importance of yet. Personally, I think this is the way to use machine learning in physics - not just looking for the how, but also the why.
Finally, I should mention that the method in itself is adapted from a 2018 paper on classifying X-ray images of body parts, which in turn references a much earlier paper on understanding how convolutional networks classify more ordinary images. It is perhaps telling that it was picked up in the medical field, since knowing that neural networks classify based on the right information could be vital there.
Wednesday, May 29, 2019
Machine learning and materials science
This post is a translation of a post that appeared on my Swedish blog in May 2019.
The other week I read an optimistic blog post on the subject of machine learning by the American skeptic and neurologist Steven Novella. He wrote, among other things, about an American research group that has trained a neural network to determine properties of doped graphene, that is graphene where some of the carbon atoms are replaced with other elements, from the placement of the dopant atoms. Novella chose to portray this as the neural network being able to perform decades of research in the course of a few days, and hinted that this could give us practical applications of graphene considerably earlier than if no machine learning had been used.
As someone who is interested in both graphene and machine learning, I obviously had to find the scientific paper the group had published and try to figure out what they had actually done.
The research question
The paper in question is published in npj Computational Materials (it is also open access, by the way) and according to the title it deals with the prediction of the so-called band gap of materials that are a combination of graphene and boron nitride. Boron nitride is a material that consists of two types of atoms, boron and nitrogen, arranged in a hexagonal lattice just like the carbon atoms in graphene. Also just like graphene, boron nitride can be produced as just a single, super-thin layer of atoms. These similarities between the two materials are a part of the reason why people try to combine them.
Another part of the reason is that while graphene has excellent electrical conductivity, it is very difficult to get boron nitride to conduct electricity at all. This difference is due to that it requires fairly little energy to get the electrons in graphene moving, while the electrons in boron nitride need a lot of extra energy to get to a state where they are mobile. This energy boost that is needed for the electrons to be able to move is also a measure of the band gap (corresponding to a gap in energy between different states that the electrons can be in). Graphene thus has an extremely small band gap, boron nitride has a large bandgap. By combining the two materials people want to create a hybrid material with a band gap of a size that is useful for e.g. applications in electronics.
However, it turns out that you cannot just replace a few carbon atoms with boron and nitrogen. How the boron and nitrogen atoms are arranged in relation to each other matters for how large the band gap of the resulting material turns out to be. What the American research group has done is try to predict the size of the bandgap based on the placement of boron and nitrogen atoms using artificial neural networks, more specifically so-called CNNs or convolutional neural networks.
The neural networks
CNNs are a type of neural networks that have been developed to pick out characteristic features from images and then classify the images based on the features - they are for example useful for facial recognition and when self-driving cars need to tell the difference between a pedestrian and a road sign. The basic principle of a CNN is similar to comparing small regions of a picture with smaller, simpler images and give a positive response if they are similar. If for example you have a picture of a house and the smaller image has a vertical line you might get a positive response when you get to the corners, doors or windows since their depictions contain straight, vertical sections. In CNN, however, you have to represent both images as matrices of numbers, and you also have several layers where the result of one comparison to a smaller image in turn is compared with more matrices (this is needed for the identification of more complex features in the image). Also note that the smaller image (or filter) is not something you define beforehand, but something the network learns. If your training data contains no straight lines, the filters that result from training probably will not do so either.
To be able to use CNNs for the graphene problem described above the researchers chose to use computer models where each pair of atoms is represented by numbers. When they introduce boron and nitrogen atoms in graphene they usually come in pairs, with a boron and a nitrogen atom next to each other. The researchers therefore chose to represent a boron-nitrogen pair with a "one" and a carbon-carbon pair with a "zero", and thereby constructed an image of the material that different types of CNNs can handle. They also built their networks to give the size of the band gap as output data.
Neural networks need to be trained with relevant data in order to work, something that usually involves automatically comparing the output of hte network to the desired result, calculating the deviation, and adjusting the neural network to give a better answer. In order to train their neural networks the researchers therefore generated several thousand possible configurations and calculated the bandgap of each configuration using density functional theory. The trained networks were then used to predict the bandgap for another batch of configurations where the calculated bandgap was known but that were not used in training. The results turned out to be very promising.
What can we learn from this?
So what is the effect of this study? The researchers have successfully shown that it is possible to predict certain properties of materials using neural networks, which should give those who do research on graphene and other two-dimensional materials another tool that they can use in their research. There is still a long way to go from this particular study to electronics based on graphene and boron nitride, but it may make it easier to know what kind of material configurations are worth working on.
Another interesting thing about this study is what it says between the lines about the limits of machine learning. For the method to work at all the neural network needs to receive all the relevant information in a format it can process, which means that it requires quite a bit of knowledge about graphene and boron nitride to even formulate the problem in such a way that it can be tackled. For example, in this study the researchers have chosen to focus completely on where each boron-nitrogen pair is situated in relation to other pairs and thus discarded all other characteristics of the material, presumably based on what is already known about these materials. (As a example, the relative orientation of neighbouring boron-nitrogen pairs is completely ignored - is it boron-nitrogen-nitrogen-boron or boron-nitrogen-boron-nitrogen? This information has been trimmed away before the neural network is involved.)
A known limitation of neural network is that it is hard to understand why they work the way they do even when they give good results. In a study like this one it would have been very interesting to see what the structures with low or high bandgap respectively have in common, but that is not information that is easy to extract from the neural network itself and the researchers seem not to have made any effort to try. I strongly suspect that a method to understand what is going on inside the networks is necessary for this type of study to be helpful in understanding the studied materials.
As you have probably understood by now, I do not quite agree with Steven Novella about this one fairly limited study showing that neural networks will do decades of research in a few days and take us significantly closer to graphene electronics, but the results in it are still interesting as an example of machine learning in materials physics.
The other week I read an optimistic blog post on the subject of machine learning by the American skeptic and neurologist Steven Novella. He wrote, among other things, about an American research group that has trained a neural network to determine properties of doped graphene, that is graphene where some of the carbon atoms are replaced with other elements, from the placement of the dopant atoms. Novella chose to portray this as the neural network being able to perform decades of research in the course of a few days, and hinted that this could give us practical applications of graphene considerably earlier than if no machine learning had been used.
As someone who is interested in both graphene and machine learning, I obviously had to find the scientific paper the group had published and try to figure out what they had actually done.
The research question
The paper in question is published in npj Computational Materials (it is also open access, by the way) and according to the title it deals with the prediction of the so-called band gap of materials that are a combination of graphene and boron nitride. Boron nitride is a material that consists of two types of atoms, boron and nitrogen, arranged in a hexagonal lattice just like the carbon atoms in graphene. Also just like graphene, boron nitride can be produced as just a single, super-thin layer of atoms. These similarities between the two materials are a part of the reason why people try to combine them.
Another part of the reason is that while graphene has excellent electrical conductivity, it is very difficult to get boron nitride to conduct electricity at all. This difference is due to that it requires fairly little energy to get the electrons in graphene moving, while the electrons in boron nitride need a lot of extra energy to get to a state where they are mobile. This energy boost that is needed for the electrons to be able to move is also a measure of the band gap (corresponding to a gap in energy between different states that the electrons can be in). Graphene thus has an extremely small band gap, boron nitride has a large bandgap. By combining the two materials people want to create a hybrid material with a band gap of a size that is useful for e.g. applications in electronics.
However, it turns out that you cannot just replace a few carbon atoms with boron and nitrogen. How the boron and nitrogen atoms are arranged in relation to each other matters for how large the band gap of the resulting material turns out to be. What the American research group has done is try to predict the size of the bandgap based on the placement of boron and nitrogen atoms using artificial neural networks, more specifically so-called CNNs or convolutional neural networks.
The neural networks
CNNs are a type of neural networks that have been developed to pick out characteristic features from images and then classify the images based on the features - they are for example useful for facial recognition and when self-driving cars need to tell the difference between a pedestrian and a road sign. The basic principle of a CNN is similar to comparing small regions of a picture with smaller, simpler images and give a positive response if they are similar. If for example you have a picture of a house and the smaller image has a vertical line you might get a positive response when you get to the corners, doors or windows since their depictions contain straight, vertical sections. In CNN, however, you have to represent both images as matrices of numbers, and you also have several layers where the result of one comparison to a smaller image in turn is compared with more matrices (this is needed for the identification of more complex features in the image). Also note that the smaller image (or filter) is not something you define beforehand, but something the network learns. If your training data contains no straight lines, the filters that result from training probably will not do so either.
To be able to use CNNs for the graphene problem described above the researchers chose to use computer models where each pair of atoms is represented by numbers. When they introduce boron and nitrogen atoms in graphene they usually come in pairs, with a boron and a nitrogen atom next to each other. The researchers therefore chose to represent a boron-nitrogen pair with a "one" and a carbon-carbon pair with a "zero", and thereby constructed an image of the material that different types of CNNs can handle. They also built their networks to give the size of the band gap as output data.
Neural networks need to be trained with relevant data in order to work, something that usually involves automatically comparing the output of hte network to the desired result, calculating the deviation, and adjusting the neural network to give a better answer. In order to train their neural networks the researchers therefore generated several thousand possible configurations and calculated the bandgap of each configuration using density functional theory. The trained networks were then used to predict the bandgap for another batch of configurations where the calculated bandgap was known but that were not used in training. The results turned out to be very promising.
What can we learn from this?
So what is the effect of this study? The researchers have successfully shown that it is possible to predict certain properties of materials using neural networks, which should give those who do research on graphene and other two-dimensional materials another tool that they can use in their research. There is still a long way to go from this particular study to electronics based on graphene and boron nitride, but it may make it easier to know what kind of material configurations are worth working on.
Another interesting thing about this study is what it says between the lines about the limits of machine learning. For the method to work at all the neural network needs to receive all the relevant information in a format it can process, which means that it requires quite a bit of knowledge about graphene and boron nitride to even formulate the problem in such a way that it can be tackled. For example, in this study the researchers have chosen to focus completely on where each boron-nitrogen pair is situated in relation to other pairs and thus discarded all other characteristics of the material, presumably based on what is already known about these materials. (As a example, the relative orientation of neighbouring boron-nitrogen pairs is completely ignored - is it boron-nitrogen-nitrogen-boron or boron-nitrogen-boron-nitrogen? This information has been trimmed away before the neural network is involved.)
A known limitation of neural network is that it is hard to understand why they work the way they do even when they give good results. In a study like this one it would have been very interesting to see what the structures with low or high bandgap respectively have in common, but that is not information that is easy to extract from the neural network itself and the researchers seem not to have made any effort to try. I strongly suspect that a method to understand what is going on inside the networks is necessary for this type of study to be helpful in understanding the studied materials.
As you have probably understood by now, I do not quite agree with Steven Novella about this one fairly limited study showing that neural networks will do decades of research in a few days and take us significantly closer to graphene electronics, but the results in it are still interesting as an example of machine learning in materials physics.
Why do we not have invisibility cloaks?
This post is a translation of a post that was published on my Swedish-language blog in December 2018.
In 2018, it was ten years since I stumbled upon the opportunity to write my Bachelor's thesis on the subject of photonic crystals. Photonic crystals are a metamaterial, an artificial material created by putting together small pieces of ordinary materials to get something with unusual properties. A photonic crystal can for example efficiently block electromagnetic radiation (light, microwaves etc.) in a specific frequency band, while frequencies outside the band get through with relatively little loss. Materials with this property could have many interesting applications, but the application that caught the attention of popular science publications at the time was that metamaterials could maybe, maybe be used to make things invisible. The obvious question is then, have we gotten any closer to having invisibility cloaks over the last 10 years?
Ten years ago it was photonic crystals specifically that people were talking about. A photonic crystal consists of at least two materials that have different optical properties - usually materials that are not electrically conducting and that have different refractive indices. It could for example be two different types of plastic or plastic and glass. The two materials are placed in a periodic structure, which for example could mean a stack of thin slabs where every other is plastic and every other is glass (Wikipedia has some excellent figures that shows what this can look like). The thickness of the slabs should correspond roughly to about half the wavelength of the electromagnetic radiation that you want to stop from propagating in the material.
Just stopping radiation of a specific frequency from propagating is, however, not enough to make something invisible. Preferably, we would like to lead the light around the object that we want to render invisible, so that the eye of people looking at it only receive light from whatever is behind the object. Theoretically this is possible with photonic crystals, due to something called effective negative refractive index.
When light passes from one material to the other, for example from air to glass, it does not continue in a straight line but changes direction with a specific angle. The angle depends on the difference in speed of light between the two materials, and this difference is expressed in terms of the refractive index. In normal materials the refractive index is positive, but in metamaterials radiation at some frequencies can change direction with a much larger angle than is ever possible in a normal material (see figure). This is expressed as the metamaterial having an effective negative refractive index. By adjusting the metamaterial to get a specific value of the refractive index it is possible to use this to control the path of light, for example to lead it around an object you want to conceal.
However, there are two problems with this. Firstly, the frequecy range where photonic crystals have a negative refractive index is usually very narrow, so a given metamaterial will only work for a small number of frequencies (say for example you would be invisible in green light but not in red or blue). Secondly, even if every layer in the photonic crystal is very thin you need a lot of layers to get a good effect. This means that even for visible light, with wavelengths below one micron, an invisibility cloak based on photonic crystals would be quite unwieldy.
Since my first contact with this field, another type of metamaterial has become more popular. Instead of mostly using non-conducting materials, the materials are built up from metallic elements or even small electric circuits. This category of metamaterials mostly builds on various resonance phenomena that can occur in metallic materials that are exposed to electromagnetic radiation. A common example is so-called split-ring resonators, that consist of to rings of metallic material where one is smaller and placed inside the other one. The rings both have an opening and they are placed so that the openings are opposite of each other. When this structure is exposed to electromagnetic radiation, this causes an electric current in the rings (induction) and electromagnetic charge will build up around the openings (capacitance). These currents and charges in turn affect surrounding electric and magnetic fields, i.e. the radiation.
A difference between traditional photonic crystals and metamaterials with metallic components is that with the metallic components the individual elements in the metamaterial, like the ring resonators for example, should be much smaller than the wavelength of the radiation that is to be stopped or controlled. This is a good thing if you want to make an "invisibility cloak" for lower frequencies (i.e. where the the wavelengths are larger) but for visible light you might run into the problem that it is still fairly difficult to make large quantities of components that are just a few tens of nanometres in size, especially since they need to be manufactured with high precision. In addition, the metallic metamaterials also only work in a limited frequency band that depends on the size of the elements. The frequency band is a bit wider than for photonic crystals, but from what I have been able to find it would still be difficult to cover for example the entire visible range. Thus, no invisibility cloak à la Harry Potter yet.
As a final note, I should probably mention that even if an invisibility cloak for the visible spectrum would be cool, that is not really what drives research in this area. Most papers I have found deal with electromagnetic radiation with wavelengths from a few millimetres up to several centimetres, which are used for e.g. radar and communication. In this frequency range metallic metamaterials work fairly well and have given applications for those who for example want to make airplanes harder to detect with radar.
In 2018, it was ten years since I stumbled upon the opportunity to write my Bachelor's thesis on the subject of photonic crystals. Photonic crystals are a metamaterial, an artificial material created by putting together small pieces of ordinary materials to get something with unusual properties. A photonic crystal can for example efficiently block electromagnetic radiation (light, microwaves etc.) in a specific frequency band, while frequencies outside the band get through with relatively little loss. Materials with this property could have many interesting applications, but the application that caught the attention of popular science publications at the time was that metamaterials could maybe, maybe be used to make things invisible. The obvious question is then, have we gotten any closer to having invisibility cloaks over the last 10 years?
Ten years ago it was photonic crystals specifically that people were talking about. A photonic crystal consists of at least two materials that have different optical properties - usually materials that are not electrically conducting and that have different refractive indices. It could for example be two different types of plastic or plastic and glass. The two materials are placed in a periodic structure, which for example could mean a stack of thin slabs where every other is plastic and every other is glass (Wikipedia has some excellent figures that shows what this can look like). The thickness of the slabs should correspond roughly to about half the wavelength of the electromagnetic radiation that you want to stop from propagating in the material.
Just stopping radiation of a specific frequency from propagating is, however, not enough to make something invisible. Preferably, we would like to lead the light around the object that we want to render invisible, so that the eye of people looking at it only receive light from whatever is behind the object. Theoretically this is possible with photonic crystals, due to something called effective negative refractive index.
When light passes from one material to the other, for example from air to glass, it does not continue in a straight line but changes direction with a specific angle. The angle depends on the difference in speed of light between the two materials, and this difference is expressed in terms of the refractive index. In normal materials the refractive index is positive, but in metamaterials radiation at some frequencies can change direction with a much larger angle than is ever possible in a normal material (see figure). This is expressed as the metamaterial having an effective negative refractive index. By adjusting the metamaterial to get a specific value of the refractive index it is possible to use this to control the path of light, for example to lead it around an object you want to conceal.
However, there are two problems with this. Firstly, the frequecy range where photonic crystals have a negative refractive index is usually very narrow, so a given metamaterial will only work for a small number of frequencies (say for example you would be invisible in green light but not in red or blue). Secondly, even if every layer in the photonic crystal is very thin you need a lot of layers to get a good effect. This means that even for visible light, with wavelengths below one micron, an invisibility cloak based on photonic crystals would be quite unwieldy.
Since my first contact with this field, another type of metamaterial has become more popular. Instead of mostly using non-conducting materials, the materials are built up from metallic elements or even small electric circuits. This category of metamaterials mostly builds on various resonance phenomena that can occur in metallic materials that are exposed to electromagnetic radiation. A common example is so-called split-ring resonators, that consist of to rings of metallic material where one is smaller and placed inside the other one. The rings both have an opening and they are placed so that the openings are opposite of each other. When this structure is exposed to electromagnetic radiation, this causes an electric current in the rings (induction) and electromagnetic charge will build up around the openings (capacitance). These currents and charges in turn affect surrounding electric and magnetic fields, i.e. the radiation.
A difference between traditional photonic crystals and metamaterials with metallic components is that with the metallic components the individual elements in the metamaterial, like the ring resonators for example, should be much smaller than the wavelength of the radiation that is to be stopped or controlled. This is a good thing if you want to make an "invisibility cloak" for lower frequencies (i.e. where the the wavelengths are larger) but for visible light you might run into the problem that it is still fairly difficult to make large quantities of components that are just a few tens of nanometres in size, especially since they need to be manufactured with high precision. In addition, the metallic metamaterials also only work in a limited frequency band that depends on the size of the elements. The frequency band is a bit wider than for photonic crystals, but from what I have been able to find it would still be difficult to cover for example the entire visible range. Thus, no invisibility cloak à la Harry Potter yet.
As a final note, I should probably mention that even if an invisibility cloak for the visible spectrum would be cool, that is not really what drives research in this area. Most papers I have found deal with electromagnetic radiation with wavelengths from a few millimetres up to several centimetres, which are used for e.g. radar and communication. In this frequency range metallic metamaterials work fairly well and have given applications for those who for example want to make airplanes harder to detect with radar.
Sunday, May 26, 2019
About radars and 'the spinning thing'
This post is a translation of a post previously published on my Swedish-language blog in September 2018.
Something I have noticed during the last few years is that if someone asks what I work with and I answer 'radar development', there is a very common follow-up question. Namely, 'does it have one of those spinning things?'
Usually, 'spinning thing' here means the typical radar display that you see in ships and airplanes, especially in movies and tv-series, with a greenish beam that sweeps around a circular display showing bright dots where the radar sees a target. Of course, sometimes 'spinning thing' also refers to the antenna in itself, since ship radar antennas are usually mounted fairly high and keep spinning around. It's a fairly natural question, since these types of radars can be found in popular culture and are in any case very visible.
As it happens, though, the types of radars that I work with do not have any sort of spinning thing. If I say so, the next question is usually something along the lines of 'then how does it work?' which is complicated and takes time to explain. It's also a very good question, so I thought I would take the time to explain it here.
If you think a bit more about that classical green radar display you quickly realize that it is a very good way to show two things: Distance to the thing the radar is detecting, and the direction the antenna was pointing in when the object was detected. Distance is one thing that is very straightforward to measure with radars: You send out a signal or radio wave pulse and wait to see if it is reflected by anything and therefore comes back, and then you calculate the distance from the time elapsed between emission of the pulse and reception of the reflected pulse. Direction is often more difficult, but for the spinning ship radar there is a simple solution - the thing the radar sees must be in the same direction as the antenna is facing when the reflected signal was received. 'The spinning thing' is thus something that helps you determine in which direction the radar target is located.
If your radar does not have a spinning thing, you need to find another way to determine which direction a signal or pulse of radio waves comes from. One way to understand how this can be achieved is to start with a type of waves that are easier to visualize, say water waves. If you are angling at a lake, your float (the red thing in the figure below is supposed to be the float, by the way) will bob up and down with the waves, sometimes being at the top of a wave and sometimes in the trough between waves.
Now imagine that you instead, for some reason, have four floats in a row in the water. If the waves are coming straight towards you, all your floats will be on the peak of a wave or in a trough at the same time. If the waves are coming from some other direction, some of your floats could be in a trough while others are not. Even if all four are affected by the same wave motion, the phase of the wave can be different for each float. If you know the wavelength and speed of the waves and the distance between the floats, you can calculate the (approximate) direction that the wave comes from the vertical position of the floats.
You can also imagine that you, on a day when the lake is calm, equip your floats with something that can create waves instead. The waves created by the different floats will interfere with each other, so if two peaks from two different floats end up in the same place at the same time they will reinforce each other, but if a peak and a trough end up in the same place at the same time the waves will cancel each other out. The end result of this will be that the resulting waves are steered in a specific direction depending on the relative phase at the different floats.
The connection between this thought experiment and radars is that the antenna elements in a radar that does not have 'the spinning thing' (say a front-looking car radar) act a lot like the floats. If the antenna that your radar emits radiation from has multiple antenna elements, you can decide that they should transmit the radio waves with small differences in phase. The emitted waves will cancel each other in some directions but not in others, with the effect of steering the resulting wave in a specific direction. By changing the relative phase between the elements it would be possible to change the direction and thereby scan the surroundings.
Another common alternative is if the receive antenna has multiple antenna elements. In this case you could have a somewhat simpler transmit antenna that illuminates a larger area with radio waves. When the waves are reflected by objects in this area they are received by the receive antenna, and the relative phase of the signal at the different receive antenna elements gives the direction of the object.
Of course, there are things that make this more complicated in reality - for example, you may need quite a lot of antenna elements if you want to look at a large area with high resolution. It can also be difficult when there are multiple objects that reflect the waves. A thing that makes the last problem easier is that reflections from objects at different distances will reach the radar at different times, so they can be separated with respect to distance before the direction is determined. In automotive radars the radial velocity of the targets relative to the radar is usually also determined, which provides another way of separating targets. An approaching car and a lamppost at the same distance from the radar can be separated based on their velocity, and then you can calculate the direction of each object separately.
Even without 'the spinning thing'.
Something I have noticed during the last few years is that if someone asks what I work with and I answer 'radar development', there is a very common follow-up question. Namely, 'does it have one of those spinning things?'
Usually, 'spinning thing' here means the typical radar display that you see in ships and airplanes, especially in movies and tv-series, with a greenish beam that sweeps around a circular display showing bright dots where the radar sees a target. Of course, sometimes 'spinning thing' also refers to the antenna in itself, since ship radar antennas are usually mounted fairly high and keep spinning around. It's a fairly natural question, since these types of radars can be found in popular culture and are in any case very visible.
As it happens, though, the types of radars that I work with do not have any sort of spinning thing. If I say so, the next question is usually something along the lines of 'then how does it work?' which is complicated and takes time to explain. It's also a very good question, so I thought I would take the time to explain it here.
If you think a bit more about that classical green radar display you quickly realize that it is a very good way to show two things: Distance to the thing the radar is detecting, and the direction the antenna was pointing in when the object was detected. Distance is one thing that is very straightforward to measure with radars: You send out a signal or radio wave pulse and wait to see if it is reflected by anything and therefore comes back, and then you calculate the distance from the time elapsed between emission of the pulse and reception of the reflected pulse. Direction is often more difficult, but for the spinning ship radar there is a simple solution - the thing the radar sees must be in the same direction as the antenna is facing when the reflected signal was received. 'The spinning thing' is thus something that helps you determine in which direction the radar target is located.
If your radar does not have a spinning thing, you need to find another way to determine which direction a signal or pulse of radio waves comes from. One way to understand how this can be achieved is to start with a type of waves that are easier to visualize, say water waves. If you are angling at a lake, your float (the red thing in the figure below is supposed to be the float, by the way) will bob up and down with the waves, sometimes being at the top of a wave and sometimes in the trough between waves.
You can also imagine that you, on a day when the lake is calm, equip your floats with something that can create waves instead. The waves created by the different floats will interfere with each other, so if two peaks from two different floats end up in the same place at the same time they will reinforce each other, but if a peak and a trough end up in the same place at the same time the waves will cancel each other out. The end result of this will be that the resulting waves are steered in a specific direction depending on the relative phase at the different floats.
The connection between this thought experiment and radars is that the antenna elements in a radar that does not have 'the spinning thing' (say a front-looking car radar) act a lot like the floats. If the antenna that your radar emits radiation from has multiple antenna elements, you can decide that they should transmit the radio waves with small differences in phase. The emitted waves will cancel each other in some directions but not in others, with the effect of steering the resulting wave in a specific direction. By changing the relative phase between the elements it would be possible to change the direction and thereby scan the surroundings.
Another common alternative is if the receive antenna has multiple antenna elements. In this case you could have a somewhat simpler transmit antenna that illuminates a larger area with radio waves. When the waves are reflected by objects in this area they are received by the receive antenna, and the relative phase of the signal at the different receive antenna elements gives the direction of the object.
Of course, there are things that make this more complicated in reality - for example, you may need quite a lot of antenna elements if you want to look at a large area with high resolution. It can also be difficult when there are multiple objects that reflect the waves. A thing that makes the last problem easier is that reflections from objects at different distances will reach the radar at different times, so they can be separated with respect to distance before the direction is determined. In automotive radars the radial velocity of the targets relative to the radar is usually also determined, which provides another way of separating targets. An approaching car and a lamppost at the same distance from the radar can be separated based on their velocity, and then you can calculate the direction of each object separately.
Even without 'the spinning thing'.
Subscribe to:
Posts (Atom)
What do we need 5G for?
During the spring of 2020 the fifth generation of cell phone systems, 5G, was launched in Sweden where I happen to live. Cell phone operator...
-
This post is a translation of a post previously published on my Swedish-language blog in September 2018. Something I have noticed during ...
-
This post is a translation of a post that appeared on my Swedish blog in May 2019. The other week I read an optimistic blog post on the s...
-
In the last post , I looked at a paper in which machine learning had been used to predict properties of doped graphene. One of my thoughts o...



