A method and apparatus are provided for video motion compensation suitable for use in decoding compressed video. An input buffer receives lines of blocks of video data and outputs lines of these to a first block transpose unit (52). This can selectively transpose the lines and columns of an input block of pixels. A vertical line filtering unit (58) is coupled to the block transpose unit for producing an output line of interpolated pixel samples. A first selector with inputs coupled to the output of the vertical line filtering unit and to the output of the input block transpose unit is able to select between an un-interpolated output line of pixels and an interpolated output line of pixel samples. A second selector (62) with inputs coupled to the outputs of the first block transpose unit and to the vertical line filtering unit is able to select between lines of pixels from the first input block transpose unit and from the vertical line filtering unit and provides these to a horizontal line filtering unit (66). The first and second selectors (60), (62) receive control signals related to motion vectors in an incoming stream of data.