Can Artificial Intelligence Systems like DALL-E or Midjourney Perform Creative Tasks?
A Series of Houses. Image © Matias del Campo / Midjourney AI via Archipaper
Share
Or
Recently we are witnessing a major shift in the process of generating images. The recent influx and growth of machine learning and artificial intelligence rises questions about the way in which creative processes evolve and develop through technology. Systems like DALL-E, DALL-E 2 and Midjourney are AI programs trained to generate images from text descriptions using a dataset of text-image pairs. The diverse set of capabilities includes creating anthropomorphized versions of animals and objects, combining unrelated concepts in plausible ways, and applying transformations to existing images.
+ 8
DALL-E and similar systems are able to create plausible images for a great variety of sentences that explore the compositional structure of language. DALL-E has some of the capabilities of a 3D rendering engine, but the difference lies in the nature of inputs. For 3D rendering, the input must be specified in complete detail, while DALL-E is often able to “fill in the blanks”. It can also independently control the attributes of a small number of objects.
These are the four initial results generated by Midjourney bots based on the prompt: “/imagine A contemporary, sustainable McDonald’s restaurant made of glass with golden arches reflecting on a lake.” . Image © Leilah Stone / Midjourney AI via Metropolis
One of the most exciting features is the ability to combine unrelated concepts. This ability could have implications for the fields of architecture and design, as it for architecture and product design to take inspiration from seemingly unrelated concepts. The AI generative models encourage designers to explore a greater number of design possibilities from a new perspective, as it lowers the time between intention and execution. They offer an accessible way to play with data and generate imaginative variations of solutions to creative problems.
Related Article
The Metaverse as Opportunity for Architects: An Interview with Patrik Schumacher
Some researchers are calling these “Artificial serendipity”, systems that maximize the opportunity for serendipity, opening up the range of creative capabilities beyond the classical methods. Architects are already experimenting with these tools to explore complex issues like urban planning and the possibilities of existing spaces. Others are combining architectural keywords with contemporary design cliches, references to pop culture and various art styles to design buildings or simply explore the nature of design trends and technology.
Canal Street is converted from a driving street to a walking street using AI. . Image © Google / Better Streets AI
<…….