Video capture

Page 1

CodeProject: Video Preview and Frames Capture to Memory with Sa...

1 di 6

Multimedia Âť Audio and Video Âť Video (GPL)

http://www.codeproject.com/KB/audio-video/video_capture.aspx?disp...

License: The GNU General Public License

Video Preview and Frames Capture to Memory with SampleGrabber in Buffered Mode.

VC8.0, C++Windows, Vista, MFC, GDI+, VS2005, Visual Studio, Dev Posted : 26 Oct 2007 Updated : 26 Oct 2007 Views : 18,325

By Chesnokov Yuriy

This article demonstrates video preview and frames capture to memory from external video devices using ISampleGrabber interface in buffered mode.

14 votes for this Article. Popularity: 4.79 Rating: 4.18 out of 5

1 2 3 4 5

Download demo project - 112.15 KB Download source - 60.33 KB

Introduction I looked around for a project capturing incoming video from external video devices to memory buffer for image processing applications and could not find the one I needed. The existing articles on The Code Project, An Easy Video Processing Framework by Grabbing Frames as Bitmaps using DirectShow, CAviCap and CFrameGrabber - Wrappers for AVICap Window, Real-time Video Image Processing / Frame Grabber using a Minimalistic Approach, Simultaneous Previewing & Video Capture using DirectShow do not provide the preferred buffering mode for capturing raw data from the stream. Some of them were tested only on WinXP and Windows 2000, pretty outdated, the latest one goes back to 1999 or captures samples from video files and so on. I have Vista on my computer and installed Windows SDK for Vista and DirectX SDK 2007. Now Direct Show is a part of Windows SDK and if you want to use ISampleGrabber for raw data capture, you need to install DirectX SDK too. I developed a simple MFC application supporting enumeration of existing video devices, preview of the video stream, capture raw image data in buffered mode with

30/07/2008 16.31

CodeProject: Video Preview and Frames Capture to Memory with Sa...

2 di 6

http://www.codeproject.com/KB/audio-video/video_capture.aspx?disp...

the desired frame rate, display it to the window with GDI+, taking snap shots to JPEG files. With that application as a skeleton, you can easily start with image/video processing tasks (video codecs development, motion estimation, edge detection). I use that one in my face detection program I'm going to post later.

Background You need to have an understanding in Direct Show programming. Have a look at the above mentioned articles or Windows Vista SDK help. Understanding of COM technology is desired - have a look at the article, Introduction to COM - What It Is and How to Use It.

Using the Code Click the enum button that will enumerate available video devices and select one. Specify the desired raw image data capture interval in milliseconds (default one is 1000, capture data every second), click the Run button. The left top small static will preview the video output and the center large one will show captured raw images. To take a snapshot, left mouse double click the center capture static window and the captured image will be saved on disk to the same directory with Snapshot X.jpg name, where X is the number of the image. For code reuse, I provided Sample Grabber and Video Capture implementation in separate files. I used the Video Capture routines from the SDK example (SDK\Samples\Multimedia\DirectShow\Capture\PlayCap). I wrapped them in functions easy to use with an external application, and also added video devices enumeration: void vcGetCaptureDevices(CComboBox& adaptersBox);

HRESULT vcCaptureVideo(HWND msgWindow, HWND prvWindow, unsigned int devIndex = 1);

void vcStopCaptureVideo();

vcGetCaptureDevices() enumerate video devices and add them to ComboBox. vcCaptureVideo() starts video preview to prvWindow with msgWindow application that will handle Filter Graph notification messages. devIndex is the index of the video device to capture data from. vcStopCaptureVideo stops capturing video data. The Sample Grabber added to Filter Graph in vcCaptureVideo functions this way:

30/07/2008 16.31

CodeProject: Video Preview and Frames Capture to Memory with Sa...

3 di 6

http://www.codeproject.com/KB/audio-video/video_capture.aspx?disp...

//... hr = sgAddSampleGrabber(g_pGraph); if (FAILED(hr)) { Msg(TEXT("Couldn't add the SampleGrabber filter to the graph! hr=0x%x"), hr); return hr; } hr = sgSetSampleGrabberMediaType(); if (FAILED(hr)) { Msg(TEXT("Couldn't set the SampleGrabber media type! hr=0x%x"), hr); return hr; } IBaseFilter* pGrabber = sgGetSampleGrabber(); // Render the preview pin on the video capture filter // Use this instead of g_pGraph->RenderFile hr = g_pCapture->RenderStream(&PIN_CATEGORY_PREVIEW, &MEDIATYPE_Video, pSrcFilter, pGrabber/*NULL*/, NULL); if (FAILED(hr)) { Msg(TEXT("Couldn't render the video capture stream. hr=0x%x\r\n") TEXT("The capture device may already be in use by another application. \r\n\r\n") TEXT("The sample will now close."), hr); pSrcFilter->Release(); return hr; } hr = sgGetSampleGrabberMediaType(); //...

The corresponding sg* functions are located in samplegrab.cpp:

30/07/2008 16.31

CodeProject: Video Preview and Frames Capture to Memory with Sa...

4 di 6

http://www.codeproject.com/KB/audio-video/video_capture.aspx?disp...

HRESULT sgAddSampleGrabber(IGraphBuilder *pGraph) { // Create the Sample Grabber. HRESULT hr = CoCreateInstance(CLSID_SampleGrabber, NULL, CLSCTX_INPROC_SERVER, IID_IBaseFilter, (void**) & pGrabberFilter); if (FAILED(hr)) { return hr; } hr = pGraph->AddFilter(pGrabberFilter, L"Sample Grabber"); if (FAILED(hr)) { return hr; } pGrabberFilter->QueryInterface(IID_ISampleGrabber, (void**)&pGrabber); return hr; } HRESULT sgSetSampleGrabberMediaType() { AM_MEDIA_TYPE mt; ZeroMemory(&mt, sizeof(AM_MEDIA_TYPE)); mt.majortype = MEDIATYPE_Video; mt.subtype = MEDIASUBTYPE_RGB24; HRESULT hr = pGrabber->SetMediaType(&mt); if (FAILED(hr)) { return hr; } //Do not stop the graph after one shot hr = pGrabber->SetOneShot(FALSE); //Use buffered mode hr = pGrabber->SetBufferSamples(TRUE); return hr; } IBaseFilter* sgGetSampleGrabber() { return pGrabberFilter; } HRESULT sgGetSampleGrabberMediaType() { AM_MEDIA_TYPE mt; HRESULT hr = pGrabber->GetConnectedMediaType(&mt); if (FAILED(hr)) { return hr; } VIDEOINFOHEADER *pVih = (VIDEOINFOHEADER *)mt.pbFormat; gChannels = pVih->bmiHeader.biBitCount / 8; gWidth = pVih->bmiHeader.biWidth; gHeight = pVih->bmiHeader.biHeight; sgFreeMediaType(mt); return hr; }

The initialization of video preview and capture is implemented in the Run button click routine CVidCapDlg::OnBnClickedRunButton() , where the timer is created to query captured raw image data by Sample Grabber filter which is the preferred way of using it as described in SDK help under the topic "Using the Sample Grabber". To grab the raw image data, use the following functions from samplegrab.h: unsigned char* sgGrabData();

Gdiplus::Bitmap* sgGetBitmap();

long sgGetBufferSize();

The first one returns a pointer to the buffer with raw image data, or NULL if the Sample Grabber is not ready yet. Note that Sample Grabber filter fills that buffer with the image turned upside down, as

30/07/2008 16.31

CodeProject: Video Preview and Frames Capture to Memory with Sa...

5 di 6

http://www.codeproject.com/KB/audio-video/video_capture.aspx?disp...

a bottom up bitmap. sgGetBitmap() returns GDI+ bitmap filled with raw image data after sgGrabData() call or NULL if the data was not captured. I use sgFlipUpDown() function to flip the raw image before copying it to the Bitmap. You should use those functions in that order, first call sgGrabData() to get the raw image and if you want Bitmap object to draw it into the window, call sgGetBitmap() later. To get the length of the buffer with raw image, call sgGetBufferSize(). The code for the grabbing is shown below: unsigned char* sgGrabData() { HRESULT hr; if (pGrabber == 0) return 0; long Size = 0; hr = pGrabber->GetCurrentBuffer(&Size, NULL); if (FAILED(hr)) return 0; else if (Size != pBufferSize) { pBufferSize = Size; if (pBuffer != 0) delete[] pBuffer; pBuffer = new unsigned char[pBufferSize]; } hr = pGrabber->GetCurrentBuffer(&pBufferSize, (long*)pBuffer); if (FAILED(hr)) return 0; else { sgFlipUpDown(pBuffer); return pBuffer; } }

To determine the image size, call these functions: unsigned int sgGetDataWidth();

unsigned int sgGetDataHeight();

unsigned int sgGetDataChannels();

License This article, along with any associated source code and files, is licensed under The GNU General Public License (GPL)

About the Author Chesnokov Yuriy

Former Cambridge University post-doc (http://www-ucc.ch.cam.ac.uk/research/yc274-research.html) currently lives in Krasnodar, Russia and doing some contract research for third parties. Research intrests in digital signal processing in medicine, image and video processing, pattern recognition, AI methods, computer vision. You may approach me for the code/research development in the above areas (chesnokov_yuriy at mail dot ru, chesnokov.yuriy at gmail dot com). Publications:

Mvp

Complexity and spectral analysis of the heart rate variability dynamics for distant prediction of paroxysmal atrial fibrillation with artificial intelligence methods. Artificial Intelligence in Medicine. 2008. V43/2. PP. 151-165

30/07/2008 16.31

CodeProject: Video Preview and Frames Capture to Memory with Sa...

6 di 6

http://www.codeproject.com/KB/audio-video/video_capture.aspx?disp...

(http://dx.doi.org/10.1016/j.artmed.2008.03.009) Face Detection C++ Library with Skin and Motion Analysis. Biometrics AIA 2007 TTS. 22 November 2007, Moscow, Russia. (http://www.dancom.ru/rus/AIA/2007TTS/ProgramAIA2007TTS.html) Screening Patients with Paroxysmal Atrial Fibrillation (PAF) from Non-PAF Heart Rhythm Using HRV Data Analysis. Computers in Cardiology 2007. V. 34. PP. 459–463 (http://www.cinc.org/Proceedings/2007/pdf/0459.pdf) Distant Prediction of Paroxysmal Atrial Fibrillation Using HRV Data Analysis. Computers in Cardiology 2007. V. 34. PP. 455-459 (http://www.cinc.org/Proceedings/2007/pdf/0455.pdf) Individually Adaptable Automatic QT Detector. Computers in Cardiology 2006. V. 33. PP. 337-341 http://www.cinc.org/Proceedings/2006/pdf/0337.pdf) Past/recent outsourcing code/research: www.ayonix.com - face recognition C/MATLAB www.system7.co.uk - CBIR C#/ASP.NET (cbir.system7.com) private enterprise in UK - pedestrian detection C++/CLI www.trulyintelligent.com - SpeechSieve consulting in AI www.devline.ru - video codecs C++ Occupation: Software Developer Location:

Russian Federation

Discussions and Feedback 31 messages have been posted for this article. Visit http://www.codeproject.com/KB/audio-video/video_capture.aspx to post and view comments on this article, or click here to get a print view with messages. PermaLink | Privacy | Terms of Use Last Updated: 26 Oct 2007 Editor: Deeksha Shenoy

Copyright 2007 by Chesnokov Yuriy Everything else Copyright © CodeProject, 1999-2008 Web10 | Advertise on the Code Project

30/07/2008 16.31

Issuu converts static files into: digital portfolios, online yearbooks, online catalogs, digital photo albums and more. Sign up and create your flipbook.