Thanks to @GoZoner's hint, I found this thread on Apple DevForums. Below is my final, working, solution.
struct Pixel { let r: UInt8 let g: UInt8 let b: UInt8 let a: UInt8}let data: CFData! = ...let width: Int = ...let height: Int = ...let pixelPtr = UnsafePointer<Pixel>(CFDataGetBytePtr(data))let pixelBuf = UnsafeBufferPointer<Pixel>(start: pixelPtr, count:width*height)