 | ||
| Sleeping Beauty has awakened. (source) GoogleNet Places205, inception_4b/pool_proj, 10 iterations, 10 octaves, scale 1.2 |
Google’s DeepDream has been called “dazzling, druggy, and creepy” (Slate), “weirdly mesmering” (Wired UK), and “utterly psychedelic and surreal […] Lovecraftian nightmare fuel” (Le Bonbon). One month after Google Research loosed their creation on the world, this artificially intelligent image recognition-turned-generation neural net has turned vast swaths of the internet into dark, globulous, glistening nests of hairy eyes and alien dog-worm larvae. Techies and laymen alike have now used DeepDream to profane everything from pizza and presidents to, unsurprisingly, porn. (Also, ahem, brass instruments—see previous post.)
But even AI needs a break from puppyslugs. What else can it do? Well, as of mid-July, various incarnations of DeepDream have been specifically trained on images of flowers (8,000), faces (27,000), cars (137,000), and, oh, ~2.5 million images of PLACES.
Bingo. DeepDream’s new job: ARCHITECT.
There are complications. When you’re talking about a deep convolutional neural network employing Hebbian learning and multi-scale processing throughout 22 layers, there are kinda bound to be. Perhaps the most salient is that instead of hiring a single recruit to our architecture firm, we’re really taking on multiple neural layers manifesting as multiple personalities.
Let’s meet them.
GoogleNet Places205 Layer Inception_4b/1x1 – “Hal”
GoogleNet Places205 Layer Inception_4b/3x3 – “Jane Goodall”
GoogleNet Places205 Layer Inception_4b/5x5 – “Indiana Jones”
GoogleNet Places205 Layer Inception_4b/Output – “PF Chang”
GoogleNet Places205 Layer Inception_4b/Pool – “Justin”
GoogleNet Places205 Layer Inception_4b/Pool_Proj – “Thomas Kinkade”
GoogleNet Places205 Layer Inception_4c/Pool_Proj – “Empress of China”
BVLC GoogleNet Layer Inception 4b/Output, 4d/3x3 – “Xanadu”
Tech Specs: I used Ryan Kennedy’s setup with Docker/container to run Google’s Python Notebook.
The logic behind their nicknames will become apparent.
Project #1: Single Building
 |
| The Crane Estate in Ipswich, MA |
The Crane Estate is classically beautiful with those chimneys, the railing, the dome…but, you know, it only has four arches. And our client really like arches.
Turns out Hal really likes arches too.
 |
| Hal’s Design GoogleNet Places205, inception_4b/1x1, 10 iterations, 4 octaves, scale 1.3 |
(click to see in full hi-res glory!)
HAL: I have added more arches, Dave.
BOSS: My name’s not Dave. Look, Hal, the arches look great, but the entire building is kinda honeycombed…I think the structural integrity may be compromised.HAL: It can only be attributable to human error, Dave.
BOSS: Not Dave! I’m gonna move on to Chang’s design, OK?
HAL: I’m sorry, Dave. I’m afraid I can’t let you do that.
BOSS: [to secretary] Page John Connor for me right now.
 |
| PF Chang’s Design GoogleNet Places205, inception_4b/output, 10 iterations, 8 octaves, scale 1.2 |
PF CHANG: As you can see, I’ve spruced up the chimneys and building corners, added a bit of moss on the brickwork, and added a bunch more of those arches you like. I also propose a labyrinth of shrub-lined walking paths in place of the lawn.
BOSS: Great.
CHANG: Also, see that little adjoining house on the right? That’ll be perfect for one of my restaurants!
BOSS: Uh, we’d have to ask the client about that. By the way, are these…flying pagodas?
CHANG: I was just doodling.
BOSS: OK. Also, what’s this…name change proposal?
CHANG: Well frankly, boss, with this redesign it looks less like a Crane Estate and kind of more like a…Chang Estate, don’t you think?
Contract awarded to: PF Chang. Cuz there’s nothing like Chinese food next door.
Project #2: Cliff Face
 |
| Palisades Park, NJ |
What happens if we ask the DeepDream Architects to design something from scratch for an undeveloped property? Let’s ask Xanadu what he would do with this raw cliff face.
 |
| Xanadu’s Design BVLC GoogleNet, inception_3b/output, 10 iterations, 4 octaves, scale 1.4 |
OH GOD NO NO NOPE. Have chosen poorly. NEVER ASK XANADU.
 |
| Jane Goodall’s Design GoogleNet Places205, inception_4b/3x3, 10 iterations, 6 octaves, scale 1.3 |
JANE GOODALL: As you can see, I’ve incorporated plenty of arches, curving garden paths, and of course, on the right there…
BOSS: A sweet crazy-ass treehouse! Love it!
GOODALL: Yes.
BOSS: One question, though: since all these units are stacked on one another, how will residents access the ones way up at the top of the cliff? I mean, they can open their front door and step right off the cliff, right?
GOODALL: The upper dwellings are reserved for the chimpanzees.
BOSS: …
GOODALL: There’s no reason we can’t peacefully co-exist.
 |
| Indiana Jones’s Design GoogleNet Places205, inception_4b/5x5, 10 iterations, 10 octaves, scale 1.2 |
BOSS: So, Indy, you’ve razed the cliff into a more gently-sloping mountainside, and built these interesting library-mansions for the residents…
INDIANA JONES: Museums. They belong in museums.
BOSS: Ah.
JONES: I’ve also included rows upon rows of trees and a huge expanse of walking paths leading to the museums. The seeds for the trees came from a long-lost temple in Madagascar. I stole them.
BOSS: Exotic. I like it.
JONES: …The resulting trees may or may not be cursed.
 |
| Thomas Kinkade’s Design GoogleNet Places205, inception_4b/pool_proj, 10 iterations, 10 octaves, scale 1.2 |
THOMAS KINKADE: I thought the bare stone of the cliff face was a bit brusque, so as you can see I’ve reduced the slope to create a gentle angel that relaxes the eye. That creates a nurturing environment for the traditional townhouses and the tall and stately palm trees.
BOSS: Wait, did you mean a gentle angle?
KINKADE: No. There’s a gentle angel casting a sunbeam filled with fairy dust right in the middle. See?
BOSS: OK, yeah. It’s twinkling.
KINKADE: Yes. Almost like… It’s almost like I painted using… You might call me the Painter of…L… Li…
BOSS: —Painter of Light. Yeah, I got it.
KINKADE: YES! Thank you!
Contract awarded to: Indiana Jones. Cuz who doesn’t like museums?
Project #3: Three Elements
 |
| Honolulu, HI |
Let’s see what our architect team will come up with given the trinity of land-air-sea, featuring this mostly-undeveloped island mountain.
 |
| Indiana Jones’s Design GoogleNet Places205, inception_4b/5x5, 10 iterations, 8 octaves, scale 1.4, 2 repetitions |
INDIANA JONES: May I present the Honolulu Isle of Museums! As you can see, I’ve carved the mountain into many magnificent museum estates, some of which are highlighted with exterior floods. Lawns and tree-lined paths lead far up to the peaks—
BOSS: —Wait. Do these paths also lead down to the ocean?
JONES: Yes.
BOSS: …And do they lead out onto the surface of the ocean?
JONES: …Yes.
BOSS: With trees and grass?
JONES: …The trick is to walk quickly and lightly enough on the paths, so your body weight doesn’t break the surface tension of the water or trigger the booby traps—
BOSS: —The WHAT??
 |
| Thomas Kinkade’s Design GoogleNet Places205, inception_4b/pool_proj, 10 iterations, 8 octaves, scale 1.25 |
BOSS: How did you flip the island around?
THOMAS KINKADE: So for this idyllic scene, I’ve chosen a series of 2-3 story townhouses in the American Art style. You can see the sprawling lawns, the towering trees, and even a small quaint stone lighthouse at the right.
BOSS: Nice. Uh, and this stuff in the water?
KINKADE: Sketches, my friend. Sketches of further dreams to come. Lift your face to the glory of the sky, too. Do you see, there? Where the air is bright, and the rooftops are…illuminated? I’ve imbued the sky with a loving glow, almost like I’ve painted not using paint, but instead… You might say I’ve painted using…using…
BOSS: Light. You painted light.
KINKADE: Yes! Which would make me…
BOSS: …
KINKADE: I might even be called the… The P… P…
BOSS: —Painter of Light. You’re the Painter of Light.
KINKADE: Thank you!!
 |
| Empress of China’s Design GoogleNet Places205, inception_4c/pool_proj, 20 iterations, 10 octaves, scale 1.25 |
BOSS: I’m impressed. Gold-topped pagoda palaces, arched bridges and trestles. And thanks for choosing to put BOATS, and not lawns or castles, in the water.
EMPRESS OF CHINA: The castles on the water are behind the island, near the waterfalls. Rest assured they have stone foundations.
BOSS: Ah. Charming. By the way, is this a steam train on the bridge, pulling into the central pagoda?
EMPRESS: Indeed. A trestle train that winds up the mountainside and links the major palaces.
BOSS: Wonderful. Oh, what are these in the upper right? Are these…baseball diamonds??
EMPRESS: …I heard the clients were American.
Contract awarded to: Empress of China. Cuz everything.
Project #4: Cityscape
 |
| Overlooking Washington Square Park, New York, NY |
Our last few challenges have dealt with undeveloped land. Next, what will our artificial artisans make of the opposite?
 |
| Justin’s Design GoogleNet Places205, inception_4b/pool, 10 iterations, 10 octaves, scale 1.2, 2 repetitions |
BOSS: It’s great to see your design, Justin. I like the tall, arched, point-topped buildings…but it does seem like there’s a lot LESS of them than before, right?
JUSTIN: I had to merge some of the buildings. And just remove some of the others. I hope that doesn’t upset anyone.
BOSS: Why would that upset anyone?
JUSTIN: Well, one of the buildings I had the remove was, well…
BOSS: Wait—did you destroy the EMPIRE STATE BUILDING??
JUSTIN: Well, I had to push back all the buildings on the left, to make room for the little street with the mini-railroad.
BOSS: Mini-railroad?
JUSTIN: J gauge. It’s brand new. There are also circular tracks in the foreground and around the fountain in the back.
BOSS: Circular tracks? As in, the trains just go in circles?
JUSTIN: Yeah! Great, isn’t it?
 |
| Indiana Jones’s Design GoogleNet Places205, inception_4b/5x5, 10 iterations, 6 octaves, scale 1.3, 2 repetitions |
BOSS: So, Indy, I see you’ve cleared most of the buildings away altogether in favor of these long tree-lined lawns and paths…
INDIANA JONES: Yes. It makes the museums more visible and the walking paths will lure people right into their entryways.
BOSS: I see. And these mountains in the distance?
JONES: Those are the cursed mountains of the fabled Shangri-La, lost through the dark ages of time. I’ll be conducting my field research there and donating all the artifacts I find to the museums. They BELONG in a MUSEUM!
BOSS: Of course they do. Now…about these trees?
JONES: Yes?
BOSS: …Are they cursed?
JONES: Whaaat? Cursed trees? Haha, no, no, not at all. No.
BOSS: [raising eyebrow]
JONES: No. Maybe.
 |
| Thomas Kinkade’s Design GoogleNet Places205, inception_4b/pool_proj, 10 iterations, 8 octaves, scale 1.25, 2 repetitions |
THOMAS KINKADE: First, there were entirely too many angular, harsh and gray buildings here. So I purified most of them, and transformed the rest with the power of love.
BOSS: Into these church-like townhouses.
KINKADE: Exactly.
BOSS: Did you demolish the Empire State Building?
KINKADE: I replaced it with a tree. I thought it was more peaceful.
BOSS: You replaced one of the most famous buildings in the world with a tree!?
KINKADE: Yes. A tall, majestic tree, growing from the roof of the main church on the left. As you see, clearing all those ugly buildings away makes room for these lovely winding paths, the tranquil pond…it’ll be so peaceful.
BOSS: Right, but aren’t these two railroad tracks running right down the middle?
KINKADE: Justin requested those. By the way, did you see the beautiful sky? With the clouds and the sky-trees, all somehow magically…illuminated…as if—
BOSS: —Painter of Light! There, I said it.
 |
| PF Chang’s Design GoogleNet Places205, inception_4b/output, 10 iterations, 8 octaves, scale 1.25, 2 repetitions |
PF CHANG: So I’ve fused and modified a chosen few buildings, including the Empire State Building, and added a lot of jungle.
BOSS: Huh. I kind of like the dense jungle.
CHANG: I expect it to be a great source of local organic ingredients for the restaurants.
BOSS: Oh. Which one is your restaurant?
CHANG: Also, you’ll notice I added some bushes in front of the buildings. The topiary is free-range and—
BOSS: —Chang, which one is your restaurant? Is it the big white building with columns on the right? I noticed no one’s really changed that in any design.
CHANG: Huh, right. I guess we just like that one the way it is.
BOSS: So that’s your restaurant?
CHANG: Actually, that’s the only one that isn’t.
 |
| Jane Goodall’s Design GoogleNet Places205, inception_4c/3x3, 20 iterations, 10 octaves, scale 1.2, 2 repetitions |
BOSS: Wow. Jane, did you actually increase the number of buildings here?
JANE GOODALL: Yes, even accounting for the ones I replanted to install the lakes.
BOSS: Replanted?…Anyway, why are they tilted?
GOODALL: You see, I’ve made them all green eco-buildings. They grow organically in clusters, spreading apart as they rise. The lakes are there to provide a nearby water source.
BOSS: Ah. I love the lakeside parks.
GOODALL: Thanks. I thought about putting parks around the sky lake too, but changed my mind.
BOSS: The sky what now?
GOODALL: Sky lake. Even the main lake isn’t enough water for that many buildings, so I replaced the sky with another lake. You can see people sailing on it.
BOSS: I…I see. But what about the sun? Do your green buildings need light?
GOODALL: That’s why I’ve created the full-spectrum fluorescent orbs that float throughout the city. They’re like souped-up giant fireflies that happen to cause sunburn if you’re not careful. Just updated street lamps, really.
BOSS: Riiight. I bet Kinkade would love those.
Contract awarded to: Jane Goodall. Cuz why the hell not. What could possibly go wrong?
Project #5: Beachfront
 |
| Kawela Bay, Honolulu, HI |
Next: a single-structure building, but with water and shore thrown in.
 |
| Jane Goodall’s Design GoogleNet Places205, inception_4c/3x3, 20 iterations, 8 octaves, scale 1.4 |
BOSS: I see you’ve opted for a similar approach.
JANE GOODALL: Yes. Green eco-skyscrapers for the humans, grouped in clusters and even waterfront mini-cities in the upper right there.
BOSS: For the humans? Then you’ve built something else for the chimps, is that it?
GOODALL: I propose converting the existing building into forest, and returning that land to Mother Nature, from whom we borrowed it but briefly. I also extended the ocean further inland.
BOSS: Yes, I see you’ve flooded the beach. What about the people that were on the beach, or in the water? There was a guy with a surfboard in the water on the right—where’d he go?
GOODALL: Well…
BOSS: And the boy with the blue shorts who was on the beach. You didn’t just ERASE him from existence, did you?
GOODALL: …What I did will save countless lives of indigenous species.
 |
| Empress of China’s Design GoogleNet Places205, inception_4c/pool_proj, 20 iterations, 10 octaves, scale 1.3 |
EMPRESS OF CHINA: Correct. It is more useful as land for water towers and a dock for the royal navy. The real buildings are the palaces on the right, with arched bridges that span across the waters.
BOSS: They’re beautiful. And I see subtle changes to the beach?
EMPRESS: There are miniature baseball diamonds for the Americans. Also the children of Americans may amuse themselves by sculpting sand pagodas and sand water towers, pictured here.
BOSS: So Beach USA, OK. Where are the people from other countries?
EMPRESS: On the ships and in the palaces.
Contract awarded to: Empress of China. Cuz at least there are still people on the beach.
Project #6: Hudson Piers
 |
| Pier 45, Hudson River Park, New York, NY |
Our next assignment: multiple waterfront buildings.
 |
| Justin’s Design GoogleNet Places205, inception_4b/pool, 10 iterations, 10 octaves, scale 1.3, 2 repetitions |
JUSTIN: As you can see, I propose fusing a couple of the buildings, and really just remaking them all in a more classic style.
BOSS: I love the tall arches.
JUSTIN: They let in more light, and allow taller trains to pass inside.
BOSS: Trains? I saw the circular tracks again, but where are the trains??
JUSTIN: Trains are susceptible to sun damage. When they’re not in service, they should be inside the stations.
BOSS: Wait. Which building is the station?
JUSTIN: They’re all train stations. But they also feature indoor shopping malls, gardens, movie theatres, and convenient access to the subway.
BOSS: Subway!? But why do you need the subway, with the trains there?
JUSTIN: It’s New York!
BOSS: OK, fair point.
 |
| PF Chang’s Design GoogleNet Places205, inception_4b/output, 10 iterations, 10 octaves, scale 1.2 |
BOSS: OK, Chang, I like the pagoda roofs, but I really like the added hill at the left with walking trails. I love walking by the water.
PF CHANG: Don’t we all? And the trails all lead into the leftmost of those three buildings.
BOSS: Let me guess. Is that your restaurant? The only one, I hope?
CHANG: …But I heard the clients are American! Those guys love my food.
 |
| Empress of China’s Design GoogleNet Places205, inception_4c/pool_proj, 20 iterations, 10 octaves, scale 1.2 |
BOSS: Empress, you’ve really outdone yourself. The buildings are fantastical and I love the bridges and bits of forest.
EMPRESS OF CHINA: Thank you. The palaces are in fact linked by a series of canals. You can pass under the bridges by boat.
BOSS: And can Americans do that?
EMPRESS: What?
BOSS: Americans can ride the boats on the canals under the bridges? …New York City is still American after all, right? Haha.
EMPRESS: For now.
Contract awarded to: Empress of China. With the stipulation that she allow PF Chang to open a restaurant, and Justin to pilot a canal boat.
Project #7: Columbus Circle, Part 1
 |
| Columbus Circle, New York, NY |
Lastly, we come to a three-part final challenge: to re-design New York’s Columbus Circle. With its mix of high-rise buildings, a corner of Central Park, the monument and circle itself, fountains, and pedestrian and vehicular traffic, it’s a multi-faceted problem. Let’s see how our DeepDream Architect team does.
 |
| Jane Goodall’s Design GoogleNet Places205, inception_4c/3x3, 10 iterations, 10 octaves, scale 1.2 |
BOSS: I’m impressed, Jane. What restraint in this relative to your previous designs.
JANE GOODALL: Yes, well, it’s a work in progress.
BOSS: You’ve pruned back the park and put in more walking trails.
GOODALL: Yes. Those serve the small eco-friendly, biodegradable houses you see at the corner.
BOSS: Ah.
GOODALL: Their electricity is naturally generated from the wind turbines there.
BOSS: How nice. Let’s see, I don’t see any other major changes…
GOODALL: Correct. Only minor adjustments. I’ve swapped out the circle’s bushes in favor of taller trees which are easier to swing from. I’ve planted grass and other prairie plants in the streets.
BOSS: Oh. Are you phasing out the cars?
GOODALL: Trees will grow from their silent husks.
BOSS: …OK.
GOODALL: Cars aren’t needed since all the houses in the park are within walking distance of each other. I am a bit disappointed the grass is taking so long to grow up through the pavement. Also the vines I’ve installed on the new reclaimed wood building faces aren’t quite thick enough to climb yet. The chim—the residents are getting a little impatient.
BOSS: Wait what?
 |
| Xanadu’s Design BVLC GoogleNet, inception_4d/3x3, 10 iterations, 4 octaves, scale 1.4 |
XANADU: I recommend replacing the circle trees with giant dogbirds, putting eyes in the streets, bending certain parts of the buildings, and erecting a capitol in the middle of the park. All I ask in return is a single building to make our hive. I’ve already chosen one for your convenience. Do you see it on the right?
BOSS: Never ask Xanadu.
Contract awarded to: Jane Goodall. Cuz at least chimps will be compassionate masters.
Project #8: Columbus Circle, Part 2
 |
| View from Columbus Circle, New York, NY |
 |
| Empress of China’s Design GoogleNet Places205, inception_4c/pool_proj, 10 iterations, 10 octaves, scale 1.2 |
BOSS: This is beautiful, Empress.
EMPRESS: Thank you. It will be a glorious sight to behold.
BOSS: I like the relocated and expanded central avenue.
EMPRESS: That leads all the way under the Arch of the Eastern City and into the Square of Justice. You can see some Americans being led there.
BOSS: Oh. What happens in the Square of Justice?
EMPRESS: …
 |
| Xanadu’s Design BVLC GoogleNet, inception_4d/3x3, 10 iterations, 4 octaves, scale 1.4, 2 repetitions |
XANADU: I recommend giving the park shrubbery sentience, putting horse-clown hybrids on the streets, and melting and fusing the building surfaces. All I ask in return is a single building to make our hive–
BOSS: Right, right, I know. But…you know what? Call me crazy, but I actually really like this.
Contract awarded to: Xanadu. With the stipulation that chimps also be allowed to reside there, and that no giant dogbirds may be installed.
Project #9: Columbus Circle, Part 3
 |
| Columbus Circle and Central Park, New York, NY |
For the final challenge, we ask the DeepDream architects to redesign the corner of Central Park at Columbus Circle, and the buildings framing it.
 |
| Indiana Jones’s Design GoogleNet Places205, inception_4b/5x5, 10 iterations, 8 octaves, scale 1.25 |
BOSS: You’ve clearly spent a lot of time planning the park redesign. The trees and winding paths are beautiful.
INDIANA JONES: Thanks. You know, my father once told me that there’s a hidden passage underneath one of those paths, that leads to catacombs underneath Columbus Circle. Legend has it that the treasures of Atlantis are hidden there, inside a subterranean temple of solid gold.
BOSS: Wow, I had no idea. Say, speaking of gold, what about that gold statue atop the pillar? You didn’t relocate it?
JONES: You mean switch it out quickly with a bag of sand of equal mass?
BOSS: I mean, you didn’t move it indoors, to, say…a MUSEUM? Hahaha!
JONES: …
BOSS: Cuz, you know, “it belongs in a MUSEUM” and all? Heehee.
JONES: Well…I guess you don’t know about the curse.
 |
| Jane Goodall’s Design GoogleNet Places205, inception_4c/3x3, 10 iterations, 10 octaves, scale 1.2 |
BOSS: Wow, carving out a hunk of the park for a lake…I love it!
JANE GOODALL: Thank you. You’ll notice the gold statue is still there. Indy said that was important.
BOSS: Sure, whatever. And I see you’ve stepped up the wind turbine installations.
GOODALL: Yes. To maximize their output I’ve placed most of them in the sky. They generate more than enough clean energy to power the floating fluoro-orbs around the high-rises. Also, the chimps can’t mess with the turbine blades up in the sky. They just get so curious…
BOSS: Speaking of curious, who is living in these high-rises?
GOODALL: The residents.
BOSS: Of course… Are they primate or human residents?
GOODALL: Humans are primates, no matter how much we may try to distance ourselves psycholog—
BOSS: —JANE. Are they HUMAN or CHIMPS??
GOODALL: …There’s no reason we can’t peacefully co-exist.
Contract awarded to: Jane Goodall. Cuz dat lake.
Project Conclusion
Well, let’s draw up our tally! We have:
Project #1: Single Building – won by PF Chang
Project #2: Cliff Face – won by Indiana Jones
Project #3: Three Elements – won by Empress of China
Project #4: Cityscape – won by Jane Goodall
Project #5: Beachfront – won by Empress of China
Project #6: Hudson Piers – won by Empress of China
Project #7: Columbus Circle, Part 1 – won by Jane Goodall
Project #8: Columbus Circle, Part 2 – won by Xanadu
Project #9: Columbus Circle, Part 3 – won by Jane Goodall
It’s a tie for first place between the Empress of China and Jane Goodall at 3 wins each; and a three-way split for second between PF Chang, Indiana Jones, and Xanadu.
But of course that’s 9 WINS for DeepDream Architect—HOORAY!!!
Epilogue
BOSS: Yes, Xanadu?
XANADU: Per our contract for Columbus Circle, I have chosen a single existing building to become our hive: your Grand Central Terminal. Our new Queen Mother is gestating there quite comfortably.
 |
| Xanadu’s Design BVLC GoogleNet, inception_4b/Output, 10 iterations, 10 octaves, scale 1.2 |
BOSS: NOPE NOPE NOPE NOPE NOPE …Never ask Xanadu.
Feel free to add/request your own DeepDream Architect designs below!
All images © 2015 That of Lowly Pwuth.
No comments:
Post a Comment