Wednesday, February 29, 2012

Keeping It Cool

Initially, at Fractal Design we had our sights set on the Sunday painter market with Painter. But, as time went on, we took on the traditional design market as well: all those people who were using traditional tools to comp up their designs. This turned out to be an excellent area of growth for us.

To entice those new customers, we began to capitalize on the cachet of the paint can. First off, the designers were a more difficult market because their demands upon the quality of the can, the manuals, and the software were much higher. To solve this problem, we had Steve Manousos, a veteran publisher with a great feeling for what looked professional. The manuals up to Painter 2.0 were written by Karen Sperling of Write-Design Studio and produced by Steve Manousos.

In Painter 2.0, released in January 1993, the new features that caught the eye were:
  • apply lighting
  • glass distortion
  • watercolors
  • recording and playback of sessions
  • brush looks
As you can see, we were adding features at a fantastic pace and so manual design, writing, and production went in-house. But how did I come up with these features?

I drew on my experience in ray tracing for both the apply lighting and glass distortion effects. I also used that expertise when coming up with the apply surface texture effect, by the way. In 1983-1985, I was busy constructing a hybrid ray tracer/shaded 3D modeler/hidden line system for AutoTrol Technologies. I have often mentioned my ability to think three-dimensionally. Well, it helped out considerably during those years. And, once again when it came to effects for Painter. I continued to draw on this knowledge when I constructed Detailer, the amazing 3D paint program.

Also, the watercolor brushes (which also had an additional layer of information) was jointly developed by Tom Hedges and Bob Lansdon during the Painter 2.0 timeframe. It is lucky indeed that they were so inclined. I later visited watercolors again in Painter 7, which used an unprecedented 4 layers of information to propagate its pigments through the capillaries of the paper grain, and which also used a cellular automata-based diffusion process to accomplish this while the user watched.

But before even all this, and before even Painter 2.0, I was advancing a secret internal tool, Texture. This was the tool used to produce nearly all of Painter's innovative textures.

To right, you can see a test sheet with 48 textures, done in February, 1992. This showed that Texture was capable of producing speckle, z-buffered rendering, annealing, and anisotropic texture using Sequential Random Addition (coming in a future post, I promise!) even in early 1992. I recognized the need to provide textures early on, because scanning paper grain was so difficult and prone to flaws.

Right around PainterX2, Steve M hired Mary Mathis-Meltzer (now Mary Zimmer) who was the uncompromising, capable editor and manager of the manual production. She totally "got" what we were looking for and made it happen wonderfully, by building an excellent crew of designers, copywriters, and artists to make better and better (and award-winning) manuals with every revision of the product.

PainterX2, released in June 1993, was a version in between 2 and 3, that had some remarkable new features:
  • layers
  • layer palette with grouping of layers
  • brushing on layers and their masks
  • portfolio for storing layers that are used in a single project
  • editable sessions
You may have noticed that in Painter 2.0, I started building a session recording and playback feature. This was continued in PainterX2 with the ability to edit the sessions. I literally documented the format so people could drive Painter using programs they wrote.

But the really big addition to this version was layers. We called them floating selections in those days, or (unfortunately) floaters for short. John Derry came up with the Portfolio concept and I implemented it. We also pioneered grouping, painting on layers and their masks, and a palette to access the layers. This was the first commercially-available program that featured this capability.

Almost simultaneously, veteran paint system pioneer Alvy Ray Smith produced a similar capability in his revolutionary Composer program from Altamira software. His was probably working before mine, so I would say that he gets the credit. Plus, he's a lot smarter than me.

Nonetheless, Fractal Design was advancing so fast and with the professional look and the quality of our product, it all made us look a lot bigger than we actually were.

So we needed an edge to complement this. And we found one: keeping it cool.

The paint can product packaging had already put the perception of Fractal Design solidly in the cool and innovative category. With Painter 2.0, we continued that.

We needed to make sure that our corporate look was in resonance with the design community. So, John Derry and I consciously moved towards the cool side in Painter 2.0 with the So Hot So Cool campaign. You can see the artwork that John produced, reminiscent of a skateboard sticker, for Painter 2.0. A Burning Ice Cube. We also adorned the Painter 2.0 can with some of the art we compiled for this campaign.

Aside from including a burning ice cube sticker inside the Painter 2.0 can, the poster inside the can also had four renditions of a burning ice cube on it, and John and I were quite proud of our campaign. People loved our posters, and we often saw them posted on doors and office walls. For us, it was well worth the investment in word-of-mouth.

Yet, perhaps we went a bit too far. Karen Bria informed us that the east coast people weren't quite understanding the skateboard sticker theme. That perhaps it appeared to be too "California". John and I were actually amazed that they even noticed. We were happy that we could have an effect with our approach, but we learned from the event nonetheless. And never stopped creating new features.

Painter 3, released in November 1994, contained the following new features:
  • new drawer-based UI
  • frame stacks: rotoscoping video
  • onion-skinning for animation
  • the Image Hose
  • physical bristle modeling
  • multiple undo
For Painter 3, we intentionally chose a less avant-garde approach with Pour It On. Here we associated the icon of the paint can with an action that symbolized the designer's mind burgeoning with ideas: pouring their ideas onto the page (without explicitly saying or depicting it, which we considered gauche and way too literal). We intentionally packed Painter 3 with new effects as well, and we knew that such things were necessary for a designer to keep their designs fresh.

The Fractal Band singing Midnight Hour - June 1995
Shown: Laurie Hemnes (now Becker), Tad Shelby (bass),
Me (keyboard), Tim Thomas (vocals),
Mary Mathis-Meltzer (now Zimmer, vocals), and John Derry (guitar)
A lot of the newness of Painter 3 was the frame stack capability. This allow the user to import a movie, paint on every frame, or to use a movie as a close source and create rotoscoped animation using all of Painter's lifelike brushes. The Image Hose was also new in Painter 3. This allowed you to draw with life. John Derry and I used the layer masking capability to get pieces of an image, say individual clovers, masked out. Then we could apply shadows to them individually. And finally structure them so you could draw with them and produce an endless array of clover. The brush became a generator of image: a literal hose of image data. This was profoundly more valuable than texture, because it brought structure to the brush.

I also got busy implementing multiple undo, bringing Painter up to modern standards. This modification stretched over three revisions of the product, because it was so complicated.

For Painter 4, released in November 1995, our features were:
  • Shapes, so you can have layers of vector art
  • net painter
  • mosaics
  • seamless pattern tiling
  • reference layers - free transform
  • web painter - GIF and JPEG formats
The mosaic feature actually came from my earlier work in Boolean polygon operations. This is an insanely difficult problem to solve. The reference layers feature allowed layers under transfer to continue to be under transform, and consequently rotatable and scaleable. This allowed the designer to try out a lot of possibilities without committing to one. It meant that small adjustments could take place without recursive re-sampling of the image, which degrades the image over time. This can be viewed as my entry into non-destructive editing. Which, of course, was the entire concept of Altamira Composer.

Seamless pattern tiling was a useful feature for this who needed to create web pages and backgrounds that tiled in various ways. You could paint into a tile and that made it possible to produce completely seamless artistic results.

Net Painter, of course, leveraged Painter's scripting capabilities. By this time, everything done in Painter was being recorded locally to the artist's machine in real time.

When it came to marketing, we weren't running out of ideas at all. And because of the mosaics feature, we decided to play on history a bit, using the Painter Through the Ages theme. For this I created a beautiful mosaic frame for the poster, The Miracle of the Paint Can. John Derry created a beautiful image, reminiscent of Vermeer, in which Priscilla Shih (now Priscilla Cinque) posed for the image.

And the Painter Power Palette Picker was a powerful tool and an innovative bit of material to accompany the poster and the manual. That was definitely cool.

Painter 5 was released in June 1997, with the following new features:
  • impasto paint
  • liquid metal paint
  • refracting water droplet paint
  • dynamic layers - non-destructive editing (lens layers, dodge and burn layers, torn edges, etc.)
  • photo brushes
  • gooey brushes
Winter of Love 3 Poster
Artist: John Derry
Painter 5 was released approximately in sync with the merger with MetaTools, and it contained a veritable wealth of new brushes and layers. The concept of non-destructive editing was taken to the extreme by having layers you could dodge and burn into, layers that refracted the data below them, and even liquid metal layers.

Painter 5's theme was A Monument to Creativity. For this I created the Mount Brushmore image. The process of ideation for the Painter 5 logo form and ad concepts is detailed in Creativity and Painter, Part 4.

Painter 6, released in September 1999, had a set of new features that were quite brush-oriented:
  • next-generation multi-bristle brush engine
  • load brushes with multiple colors
  • leaner, clearer UI
  • life-like natural spray airbrushes
  • Interactive Image Hose, allowing changes to scale and rotation in real time
  • Painting with patterns, neon, tubes, and gradients
  • responsive palette knife
These led us to take an approach that featured brushes. Because Only Painter could do these things. This was less cool and more of a preservationist attitude. In response to products imitating Painter's capabilities. In response to Photoshop duplicating Painter's brushwork.

Painter 7 had a set of new features that I worked on as well, in the form of a consultant working for Corel:
  • liquid ink
  • watercolor version 2 (much more realistic)
  • animated absorption of pigment 
  • woodcut effect
So, the theme of producing great brushes and effects, combined with innovations like layers and interactive 3D lighting drove us to highlight the features with innovative campaigns. In each new release, we strove to maintain our creativity, and thus bolster the creativity of the artists who still choose Painter worldwide.

    7 comments:

    1. I an enjoying your site immensely. I love the history and the insider information about the thought processes behind the product. I didn't know about Painter until around the middle of 2008, but I love the program. I wish I had known it back in the early days. Thanks for sharing.

      ReplyDelete
      Replies
      1. You are totally welcome! So many years ago, all this stuff actually happened. It was a very busy time for about ten years there, working day and night to continue to keep it cool for the users of Painter. Funny how, even with the turbulent times (IPOs, mergers, acquisitions, obnoxious board members, skeptical venture capitalists) we were able to forge on. It always seemed to me that the only ones outside the company who got what we were doing were the artists and designers.

        I got a big charge out of showing stuff for the first time. I'll see if I can find some pictures of how it was to actually demo this stuff to giant crowds. Never a dull moment!

        Delete
    2. Did your innovation for non-destructive editing precede (and possibly influence?) Layers in Adobe Photoshop (Q4 1994)?

      Given my limited artistic ability (mostly composition, although I faithfully reproduced the Journey album covers freehand on my walls, when I was teenager), layers is probably the most important feature I've used in an image editor, e.g. the art at my coolpage.com (circa 1998).

      If you have or will ever blog about the boolean polygon operations for the mosaic tool, I am very interested. I read The Miracle of the Paint Can.

      When I was debugging low-level Painter code, I often didn't know what algorithm the code was supposed to be doing. I had to figure it out just by looking at (tersely or undocumented) code, which was sometimes assembly language. I remember one bug in (C code for) a deeply nested recursion of unraveling the grain (or something) that I nailed just because I recognized a pattern in the code, even though I really didn't know what the code was doing in the overall scheme of things. So I am very interested in reading about the algorithms I was debugging ;) And generally interested in your clever algorithms.

      I do believe having to reverse engineer algorithms, improved my skills as a programmer. It was an exciting time. Also, the internet was just blooming mid-1990s.

      ReplyDelete
      Replies
      1. P.S. Perhaps Tad Shelby (from marketing dept, and in your band) and I are distantly related, descended from Isaac Shelby.

        Delete
      2. Photoshops original Layers implementation was approximately equivalent To Painters flatters implementation about 15 months earlier. I think we probably came up with very different non-destructive editing capabilities about the same time. Ours had stuff like refraction. Theirs were more like shadows, which we had from the start, but it was an applied effect, unlike photoshops attribute-based method.

        Great minds think alike, but not always.

        I chronicle the layer competition in the blog post The Most Useful Painter Feature. There is more in another pat. Just search my blog for Alvy Ray Smith. He, Porter, and Duff were compositing geniuses at Pixar long before I started doing it, of course.

        Boolean Polygon Operations are a real drag to implement. I think I started in 1976 and continued until 1993 until I got it right.

        Delete
    3. Hey Mark.

      Fred Krueger (from Matisse) here. I just found your blog and was re-living the 1993-1995 phase here. It never occurred to me you would design your textures algorithmically. That's extremely cool.

      ReplyDelete
    4. Fred,

      Yes, I built my textures with the Texture program (which I have recently resurrected, chronicled in the Texture posts). Many of the textures were created using arcane techniques such as simulated annealing, Voronoi tessellations, and non-linear Fourier-domain filtering. All these methods had to be made suitable for applying to a wrap-around topology. If I were really on the ball, I would have kept the recipes around and made sure that all the textures could be reproduced. But as it is, I think each one gets its own article in the Journal of Irreproducible Results.

      --Mark

      ReplyDelete