2005-04-16 16:20:36 -06:00
|
|
|
/**
|
2005-09-24 22:28:13 -06:00
|
|
|
* \file drm_vm.c
|
2005-04-16 16:20:36 -06:00
|
|
|
* Memory mapping for DRM
|
2005-09-24 22:28:13 -06:00
|
|
|
*
|
2005-04-16 16:20:36 -06:00
|
|
|
* \author Rickard E. (Rik) Faith <faith@valinux.com>
|
|
|
|
* \author Gareth Hughes <gareth@valinux.com>
|
|
|
|
*/
|
|
|
|
|
|
|
|
/*
|
|
|
|
* Created: Mon Jan 4 08:58:31 1999 by faith@valinux.com
|
|
|
|
*
|
|
|
|
* Copyright 1999 Precision Insight, Inc., Cedar Park, Texas.
|
|
|
|
* Copyright 2000 VA Linux Systems, Inc., Sunnyvale, California.
|
|
|
|
* All Rights Reserved.
|
|
|
|
*
|
|
|
|
* Permission is hereby granted, free of charge, to any person obtaining a
|
|
|
|
* copy of this software and associated documentation files (the "Software"),
|
|
|
|
* to deal in the Software without restriction, including without limitation
|
|
|
|
* the rights to use, copy, modify, merge, publish, distribute, sublicense,
|
|
|
|
* and/or sell copies of the Software, and to permit persons to whom the
|
|
|
|
* Software is furnished to do so, subject to the following conditions:
|
|
|
|
*
|
|
|
|
* The above copyright notice and this permission notice (including the next
|
|
|
|
* paragraph) shall be included in all copies or substantial portions of the
|
|
|
|
* Software.
|
|
|
|
*
|
|
|
|
* THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
|
|
|
* IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
|
|
|
* FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL
|
|
|
|
* VA LINUX SYSTEMS AND/OR ITS SUPPLIERS BE LIABLE FOR ANY CLAIM, DAMAGES OR
|
|
|
|
* OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE,
|
|
|
|
* ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR
|
|
|
|
* OTHER DEALINGS IN THE SOFTWARE.
|
|
|
|
*/
|
|
|
|
|
|
|
|
#include "drmP.h"
|
2011-08-30 16:16:33 -06:00
|
|
|
#include <linux/export.h>
|
2005-04-16 16:20:36 -06:00
|
|
|
#if defined(__ia64__)
|
|
|
|
#include <linux/efi.h>
|
include cleanup: Update gfp.h and slab.h includes to prepare for breaking implicit slab.h inclusion from percpu.h
percpu.h is included by sched.h and module.h and thus ends up being
included when building most .c files. percpu.h includes slab.h which
in turn includes gfp.h making everything defined by the two files
universally available and complicating inclusion dependencies.
percpu.h -> slab.h dependency is about to be removed. Prepare for
this change by updating users of gfp and slab facilities include those
headers directly instead of assuming availability. As this conversion
needs to touch large number of source files, the following script is
used as the basis of conversion.
http://userweb.kernel.org/~tj/misc/slabh-sweep.py
The script does the followings.
* Scan files for gfp and slab usages and update includes such that
only the necessary includes are there. ie. if only gfp is used,
gfp.h, if slab is used, slab.h.
* When the script inserts a new include, it looks at the include
blocks and try to put the new include such that its order conforms
to its surrounding. It's put in the include block which contains
core kernel includes, in the same order that the rest are ordered -
alphabetical, Christmas tree, rev-Xmas-tree or at the end if there
doesn't seem to be any matching order.
* If the script can't find a place to put a new include (mostly
because the file doesn't have fitting include block), it prints out
an error message indicating which .h file needs to be added to the
file.
The conversion was done in the following steps.
1. The initial automatic conversion of all .c files updated slightly
over 4000 files, deleting around 700 includes and adding ~480 gfp.h
and ~3000 slab.h inclusions. The script emitted errors for ~400
files.
2. Each error was manually checked. Some didn't need the inclusion,
some needed manual addition while adding it to implementation .h or
embedding .c file was more appropriate for others. This step added
inclusions to around 150 files.
3. The script was run again and the output was compared to the edits
from #2 to make sure no file was left behind.
4. Several build tests were done and a couple of problems were fixed.
e.g. lib/decompress_*.c used malloc/free() wrappers around slab
APIs requiring slab.h to be added manually.
5. The script was run on all .h files but without automatically
editing them as sprinkling gfp.h and slab.h inclusions around .h
files could easily lead to inclusion dependency hell. Most gfp.h
inclusion directives were ignored as stuff from gfp.h was usually
wildly available and often used in preprocessor macros. Each
slab.h inclusion directive was examined and added manually as
necessary.
6. percpu.h was updated not to include slab.h.
7. Build test were done on the following configurations and failures
were fixed. CONFIG_GCOV_KERNEL was turned off for all tests (as my
distributed build env didn't work with gcov compiles) and a few
more options had to be turned off depending on archs to make things
build (like ipr on powerpc/64 which failed due to missing writeq).
* x86 and x86_64 UP and SMP allmodconfig and a custom test config.
* powerpc and powerpc64 SMP allmodconfig
* sparc and sparc64 SMP allmodconfig
* ia64 SMP allmodconfig
* s390 SMP allmodconfig
* alpha SMP allmodconfig
* um on x86_64 SMP allmodconfig
8. percpu.h modifications were reverted so that it could be applied as
a separate patch and serve as bisection point.
Given the fact that I had only a couple of failures from tests on step
6, I'm fairly confident about the coverage of this conversion patch.
If there is a breakage, it's likely to be something in one of the arch
headers which should be easily discoverable easily on most builds of
the specific arch.
Signed-off-by: Tejun Heo <tj@kernel.org>
Guess-its-ok-by: Christoph Lameter <cl@linux-foundation.org>
Cc: Ingo Molnar <mingo@redhat.com>
Cc: Lee Schermerhorn <Lee.Schermerhorn@hp.com>
2010-03-24 02:04:11 -06:00
|
|
|
#include <linux/slab.h>
|
2005-04-16 16:20:36 -06:00
|
|
|
#endif
|
|
|
|
|
2005-07-07 05:03:38 -06:00
|
|
|
static void drm_vm_open(struct vm_area_struct *vma);
|
|
|
|
static void drm_vm_close(struct vm_area_struct *vma);
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2007-03-10 17:41:16 -07:00
|
|
|
static pgprot_t drm_io_prot(uint32_t map_type, struct vm_area_struct *vma)
|
2007-02-09 17:53:13 -07:00
|
|
|
{
|
|
|
|
pgprot_t tmp = vm_get_page_prot(vma->vm_flags);
|
|
|
|
|
|
|
|
#if defined(__i386__) || defined(__x86_64__)
|
|
|
|
if (boot_cpu_data.x86 > 3 && map_type != _DRM_AGP) {
|
|
|
|
pgprot_val(tmp) |= _PAGE_PCD;
|
|
|
|
pgprot_val(tmp) &= ~_PAGE_PWT;
|
|
|
|
}
|
|
|
|
#elif defined(__powerpc__)
|
|
|
|
pgprot_val(tmp) |= _PAGE_NO_CACHE;
|
|
|
|
if (map_type == _DRM_REGISTERS)
|
|
|
|
pgprot_val(tmp) |= _PAGE_GUARDED;
|
2008-03-28 15:23:07 -06:00
|
|
|
#elif defined(__ia64__)
|
2007-02-09 17:53:13 -07:00
|
|
|
if (efi_range_is_wc(vma->vm_start, vma->vm_end -
|
|
|
|
vma->vm_start))
|
|
|
|
tmp = pgprot_writecombine(tmp);
|
|
|
|
else
|
|
|
|
tmp = pgprot_noncached(tmp);
|
2010-05-27 13:40:26 -06:00
|
|
|
#elif defined(__sparc__) || defined(__arm__)
|
2008-03-28 15:23:07 -06:00
|
|
|
tmp = pgprot_noncached(tmp);
|
|
|
|
#endif
|
|
|
|
return tmp;
|
|
|
|
}
|
|
|
|
|
|
|
|
static pgprot_t drm_dma_prot(uint32_t map_type, struct vm_area_struct *vma)
|
|
|
|
{
|
|
|
|
pgprot_t tmp = vm_get_page_prot(vma->vm_flags);
|
|
|
|
|
|
|
|
#if defined(__powerpc__) && defined(CONFIG_NOT_COHERENT_CACHE)
|
|
|
|
tmp |= _PAGE_NO_CACHE;
|
2007-02-09 17:53:13 -07:00
|
|
|
#endif
|
|
|
|
return tmp;
|
|
|
|
}
|
|
|
|
|
2005-04-16 16:20:36 -06:00
|
|
|
/**
|
2008-02-06 23:20:50 -07:00
|
|
|
* \c fault method for AGP virtual memory.
|
2005-04-16 16:20:36 -06:00
|
|
|
*
|
|
|
|
* \param vma virtual memory area.
|
|
|
|
* \param address access address.
|
|
|
|
* \return pointer to the page structure.
|
2005-09-24 22:28:13 -06:00
|
|
|
*
|
2005-04-16 16:20:36 -06:00
|
|
|
* Find the right map and if it's AGP memory find the real physical page to
|
|
|
|
* map, get the page, increment the use count and return it.
|
|
|
|
*/
|
|
|
|
#if __OS_HAS_AGP
|
2008-02-06 23:20:50 -07:00
|
|
|
static int drm_do_vm_fault(struct vm_area_struct *vma, struct vm_fault *vmf)
|
2005-04-16 16:20:36 -06:00
|
|
|
{
|
2007-07-10 23:53:27 -06:00
|
|
|
struct drm_file *priv = vma->vm_file->private_data;
|
2008-04-21 00:47:32 -06:00
|
|
|
struct drm_device *dev = priv->minor->dev;
|
2009-02-01 22:55:46 -07:00
|
|
|
struct drm_local_map *map = NULL;
|
2007-07-11 00:53:40 -06:00
|
|
|
struct drm_map_list *r_list;
|
2007-07-11 18:26:44 -06:00
|
|
|
struct drm_hash_item *hash;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
|
|
|
/*
|
2005-09-24 22:28:13 -06:00
|
|
|
* Find the right map
|
|
|
|
*/
|
2005-04-16 16:20:36 -06:00
|
|
|
if (!drm_core_has_AGP(dev))
|
2008-02-06 23:20:50 -07:00
|
|
|
goto vm_fault_error;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2005-09-24 22:28:13 -06:00
|
|
|
if (!dev->agp || !dev->agp->cant_use_aperture)
|
2008-02-06 23:20:50 -07:00
|
|
|
goto vm_fault_error;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2007-02-07 22:14:05 -07:00
|
|
|
if (drm_ht_find_item(&dev->map_hash, vma->vm_pgoff, &hash))
|
2008-02-06 23:20:50 -07:00
|
|
|
goto vm_fault_error;
|
2006-08-07 06:36:47 -06:00
|
|
|
|
2007-07-11 00:53:40 -06:00
|
|
|
r_list = drm_hash_entry(hash, struct drm_map_list, hash);
|
2006-08-07 06:36:47 -06:00
|
|
|
map = r_list->map;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
|
|
|
if (map && map->type == _DRM_AGP) {
|
2008-02-06 23:20:50 -07:00
|
|
|
/*
|
|
|
|
* Using vm_pgoff as a selector forces us to use this unusual
|
|
|
|
* addressing scheme.
|
|
|
|
*/
|
2009-02-01 22:55:47 -07:00
|
|
|
resource_size_t offset = (unsigned long)vmf->virtual_address -
|
|
|
|
vma->vm_start;
|
|
|
|
resource_size_t baddr = map->offset + offset;
|
2005-04-16 16:20:36 -06:00
|
|
|
struct drm_agp_mem *agpmem;
|
|
|
|
struct page *page;
|
|
|
|
|
|
|
|
#ifdef __alpha__
|
|
|
|
/*
|
2005-09-24 22:28:13 -06:00
|
|
|
* Adjust to a bus-relative address
|
|
|
|
*/
|
2005-04-16 16:20:36 -06:00
|
|
|
baddr -= dev->hose->mem_space->start;
|
|
|
|
#endif
|
|
|
|
|
|
|
|
/*
|
2005-09-24 22:28:13 -06:00
|
|
|
* It's AGP memory - find the real physical page to map
|
|
|
|
*/
|
2007-05-25 13:01:51 -06:00
|
|
|
list_for_each_entry(agpmem, &dev->agp->memory, head) {
|
2005-04-16 16:20:36 -06:00
|
|
|
if (agpmem->bound <= baddr &&
|
2005-09-24 22:28:13 -06:00
|
|
|
agpmem->bound + agpmem->pages * PAGE_SIZE > baddr)
|
2005-04-16 16:20:36 -06:00
|
|
|
break;
|
|
|
|
}
|
|
|
|
|
2010-08-19 03:39:57 -06:00
|
|
|
if (&agpmem->head == &dev->agp->memory)
|
2008-02-06 23:20:50 -07:00
|
|
|
goto vm_fault_error;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
|
|
|
/*
|
2005-09-24 22:28:13 -06:00
|
|
|
* Get the page, inc the use count, and return it
|
|
|
|
*/
|
2005-04-16 16:20:36 -06:00
|
|
|
offset = (baddr - agpmem->bound) >> PAGE_SHIFT;
|
2009-06-11 22:11:41 -06:00
|
|
|
page = agpmem->memory->pages[offset];
|
2005-04-16 16:20:36 -06:00
|
|
|
get_page(page);
|
2008-02-06 23:20:50 -07:00
|
|
|
vmf->page = page;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2005-09-24 22:28:13 -06:00
|
|
|
DRM_DEBUG
|
2009-02-01 22:55:47 -07:00
|
|
|
("baddr = 0x%llx page = 0x%p, offset = 0x%llx, count=%d\n",
|
|
|
|
(unsigned long long)baddr,
|
2009-06-11 22:11:41 -06:00
|
|
|
agpmem->memory->pages[offset],
|
2009-02-01 22:55:47 -07:00
|
|
|
(unsigned long long)offset,
|
2005-09-24 22:28:13 -06:00
|
|
|
page_count(page));
|
2008-02-06 23:20:50 -07:00
|
|
|
return 0;
|
2005-09-24 22:28:13 -06:00
|
|
|
}
|
2008-02-06 23:20:50 -07:00
|
|
|
vm_fault_error:
|
|
|
|
return VM_FAULT_SIGBUS; /* Disallow mremap */
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
2005-09-24 22:28:13 -06:00
|
|
|
#else /* __OS_HAS_AGP */
|
2008-02-06 23:20:50 -07:00
|
|
|
static int drm_do_vm_fault(struct vm_area_struct *vma, struct vm_fault *vmf)
|
2005-04-16 16:20:36 -06:00
|
|
|
{
|
2008-02-06 23:20:50 -07:00
|
|
|
return VM_FAULT_SIGBUS;
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
2005-09-24 22:28:13 -06:00
|
|
|
#endif /* __OS_HAS_AGP */
|
2005-04-16 16:20:36 -06:00
|
|
|
|
|
|
|
/**
|
|
|
|
* \c nopage method for shared virtual memory.
|
|
|
|
*
|
|
|
|
* \param vma virtual memory area.
|
|
|
|
* \param address access address.
|
|
|
|
* \return pointer to the page structure.
|
2005-09-24 22:28:13 -06:00
|
|
|
*
|
2007-05-09 00:57:56 -06:00
|
|
|
* Get the mapping, find the real physical page to map, get the page, and
|
2005-04-16 16:20:36 -06:00
|
|
|
* return it.
|
|
|
|
*/
|
2008-02-06 23:20:50 -07:00
|
|
|
static int drm_do_vm_shm_fault(struct vm_area_struct *vma, struct vm_fault *vmf)
|
2005-04-16 16:20:36 -06:00
|
|
|
{
|
2009-02-01 22:55:46 -07:00
|
|
|
struct drm_local_map *map = vma->vm_private_data;
|
2005-09-24 22:28:13 -06:00
|
|
|
unsigned long offset;
|
|
|
|
unsigned long i;
|
|
|
|
struct page *page;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2005-09-24 22:28:13 -06:00
|
|
|
if (!map)
|
2008-02-06 23:20:50 -07:00
|
|
|
return VM_FAULT_SIGBUS; /* Nothing allocated */
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2008-02-06 23:20:50 -07:00
|
|
|
offset = (unsigned long)vmf->virtual_address - vma->vm_start;
|
2005-04-16 16:20:36 -06:00
|
|
|
i = (unsigned long)map->handle + offset;
|
2007-03-24 00:55:16 -06:00
|
|
|
page = vmalloc_to_page((void *)i);
|
2005-04-16 16:20:36 -06:00
|
|
|
if (!page)
|
2008-02-06 23:20:50 -07:00
|
|
|
return VM_FAULT_SIGBUS;
|
2005-04-16 16:20:36 -06:00
|
|
|
get_page(page);
|
2008-02-06 23:20:50 -07:00
|
|
|
vmf->page = page;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2008-02-06 23:20:50 -07:00
|
|
|
DRM_DEBUG("shm_fault 0x%lx\n", offset);
|
|
|
|
return 0;
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
|
|
|
|
|
|
|
/**
|
|
|
|
* \c close method for shared virtual memory.
|
2005-09-24 22:28:13 -06:00
|
|
|
*
|
2005-04-16 16:20:36 -06:00
|
|
|
* \param vma virtual memory area.
|
2005-09-24 22:28:13 -06:00
|
|
|
*
|
2005-04-16 16:20:36 -06:00
|
|
|
* Deletes map information if we are the last
|
|
|
|
* person to close a mapping and it's not in the global maplist.
|
|
|
|
*/
|
2005-07-07 05:03:38 -06:00
|
|
|
static void drm_vm_shm_close(struct vm_area_struct *vma)
|
2005-04-16 16:20:36 -06:00
|
|
|
{
|
2007-07-10 23:53:27 -06:00
|
|
|
struct drm_file *priv = vma->vm_file->private_data;
|
2008-04-21 00:47:32 -06:00
|
|
|
struct drm_device *dev = priv->minor->dev;
|
2007-07-11 00:21:47 -06:00
|
|
|
struct drm_vma_entry *pt, *temp;
|
2009-02-01 22:55:46 -07:00
|
|
|
struct drm_local_map *map;
|
2007-07-11 00:53:40 -06:00
|
|
|
struct drm_map_list *r_list;
|
2005-04-16 16:20:36 -06:00
|
|
|
int found_maps = 0;
|
|
|
|
|
|
|
|
DRM_DEBUG("0x%08lx,0x%08lx\n",
|
|
|
|
vma->vm_start, vma->vm_end - vma->vm_start);
|
|
|
|
atomic_dec(&dev->vma_count);
|
|
|
|
|
|
|
|
map = vma->vm_private_data;
|
|
|
|
|
2006-02-02 01:37:46 -07:00
|
|
|
mutex_lock(&dev->struct_mutex);
|
2007-05-25 13:01:51 -06:00
|
|
|
list_for_each_entry_safe(pt, temp, &dev->vmalist, head) {
|
2005-09-24 22:28:13 -06:00
|
|
|
if (pt->vma->vm_private_data == map)
|
|
|
|
found_maps++;
|
2005-04-16 16:20:36 -06:00
|
|
|
if (pt->vma == vma) {
|
2007-05-25 13:01:51 -06:00
|
|
|
list_del(&pt->head);
|
2009-03-24 13:23:04 -06:00
|
|
|
kfree(pt);
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
|
|
|
}
|
2007-05-25 13:01:51 -06:00
|
|
|
|
2005-04-16 16:20:36 -06:00
|
|
|
/* We were the only map that was found */
|
2005-09-24 22:28:13 -06:00
|
|
|
if (found_maps == 1 && map->flags & _DRM_REMOVABLE) {
|
2005-04-16 16:20:36 -06:00
|
|
|
/* Check to see if we are in the maplist, if we are not, then
|
|
|
|
* we delete this mappings information.
|
|
|
|
*/
|
|
|
|
found_maps = 0;
|
2007-05-25 13:01:51 -06:00
|
|
|
list_for_each_entry(r_list, &dev->maplist, head) {
|
2005-09-24 22:28:13 -06:00
|
|
|
if (r_list->map == map)
|
|
|
|
found_maps++;
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
|
|
|
|
2005-09-24 22:28:13 -06:00
|
|
|
if (!found_maps) {
|
2005-07-09 23:38:56 -06:00
|
|
|
drm_dma_handle_t dmah;
|
|
|
|
|
2005-04-16 16:20:36 -06:00
|
|
|
switch (map->type) {
|
|
|
|
case _DRM_REGISTERS:
|
|
|
|
case _DRM_FRAME_BUFFER:
|
|
|
|
if (drm_core_has_MTRR(dev) && map->mtrr >= 0) {
|
|
|
|
int retcode;
|
|
|
|
retcode = mtrr_del(map->mtrr,
|
|
|
|
map->offset,
|
|
|
|
map->size);
|
|
|
|
DRM_DEBUG("mtrr_del = %d\n", retcode);
|
|
|
|
}
|
2007-01-08 03:56:59 -07:00
|
|
|
iounmap(map->handle);
|
2005-04-16 16:20:36 -06:00
|
|
|
break;
|
|
|
|
case _DRM_SHM:
|
|
|
|
vfree(map->handle);
|
|
|
|
break;
|
|
|
|
case _DRM_AGP:
|
|
|
|
case _DRM_SCATTER_GATHER:
|
|
|
|
break;
|
2005-07-09 22:34:13 -06:00
|
|
|
case _DRM_CONSISTENT:
|
2005-07-09 23:38:56 -06:00
|
|
|
dmah.vaddr = map->handle;
|
|
|
|
dmah.busaddr = map->offset;
|
|
|
|
dmah.size = map->size;
|
|
|
|
__drm_pci_free(dev, &dmah);
|
2005-07-09 22:34:13 -06:00
|
|
|
break;
|
2008-11-05 11:31:53 -07:00
|
|
|
case _DRM_GEM:
|
|
|
|
DRM_ERROR("tried to rmmap GEM object\n");
|
|
|
|
break;
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
2009-03-24 13:23:04 -06:00
|
|
|
kfree(map);
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
|
|
|
}
|
2006-02-02 01:37:46 -07:00
|
|
|
mutex_unlock(&dev->struct_mutex);
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
|
|
|
|
|
|
|
/**
|
2008-02-06 23:20:50 -07:00
|
|
|
* \c fault method for DMA virtual memory.
|
2005-04-16 16:20:36 -06:00
|
|
|
*
|
|
|
|
* \param vma virtual memory area.
|
|
|
|
* \param address access address.
|
|
|
|
* \return pointer to the page structure.
|
2005-09-24 22:28:13 -06:00
|
|
|
*
|
2005-04-16 16:20:36 -06:00
|
|
|
* Determine the page number from the page offset and get it from drm_device_dma::pagelist.
|
|
|
|
*/
|
2008-02-06 23:20:50 -07:00
|
|
|
static int drm_do_vm_dma_fault(struct vm_area_struct *vma, struct vm_fault *vmf)
|
2005-04-16 16:20:36 -06:00
|
|
|
{
|
2007-07-10 23:53:27 -06:00
|
|
|
struct drm_file *priv = vma->vm_file->private_data;
|
2008-04-21 00:47:32 -06:00
|
|
|
struct drm_device *dev = priv->minor->dev;
|
2007-07-11 00:32:08 -06:00
|
|
|
struct drm_device_dma *dma = dev->dma;
|
2005-09-24 22:28:13 -06:00
|
|
|
unsigned long offset;
|
|
|
|
unsigned long page_nr;
|
|
|
|
struct page *page;
|
|
|
|
|
|
|
|
if (!dma)
|
2008-02-06 23:20:50 -07:00
|
|
|
return VM_FAULT_SIGBUS; /* Error */
|
2005-09-24 22:28:13 -06:00
|
|
|
if (!dma->pagelist)
|
2008-02-06 23:20:50 -07:00
|
|
|
return VM_FAULT_SIGBUS; /* Nothing allocated */
|
2005-09-24 22:28:13 -06:00
|
|
|
|
2008-02-06 23:20:50 -07:00
|
|
|
offset = (unsigned long)vmf->virtual_address - vma->vm_start; /* vm_[pg]off[set] should be 0 */
|
|
|
|
page_nr = offset >> PAGE_SHIFT; /* page_nr could just be vmf->pgoff */
|
2005-09-24 22:28:13 -06:00
|
|
|
page = virt_to_page((dma->pagelist[page_nr] + (offset & (~PAGE_MASK))));
|
2005-04-16 16:20:36 -06:00
|
|
|
|
|
|
|
get_page(page);
|
2008-02-06 23:20:50 -07:00
|
|
|
vmf->page = page;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2008-02-06 23:20:50 -07:00
|
|
|
DRM_DEBUG("dma_fault 0x%lx (page %lu)\n", offset, page_nr);
|
|
|
|
return 0;
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
|
|
|
|
|
|
|
/**
|
2008-02-06 23:20:50 -07:00
|
|
|
* \c fault method for scatter-gather virtual memory.
|
2005-04-16 16:20:36 -06:00
|
|
|
*
|
|
|
|
* \param vma virtual memory area.
|
|
|
|
* \param address access address.
|
|
|
|
* \return pointer to the page structure.
|
2005-09-24 22:28:13 -06:00
|
|
|
*
|
2005-04-16 16:20:36 -06:00
|
|
|
* Determine the map offset from the page offset and get it from drm_sg_mem::pagelist.
|
|
|
|
*/
|
2008-02-06 23:20:50 -07:00
|
|
|
static int drm_do_vm_sg_fault(struct vm_area_struct *vma, struct vm_fault *vmf)
|
2005-04-16 16:20:36 -06:00
|
|
|
{
|
2009-02-01 22:55:46 -07:00
|
|
|
struct drm_local_map *map = vma->vm_private_data;
|
2007-07-10 23:53:27 -06:00
|
|
|
struct drm_file *priv = vma->vm_file->private_data;
|
2008-04-21 00:47:32 -06:00
|
|
|
struct drm_device *dev = priv->minor->dev;
|
2007-07-11 00:53:40 -06:00
|
|
|
struct drm_sg_mem *entry = dev->sg;
|
2005-04-16 16:20:36 -06:00
|
|
|
unsigned long offset;
|
|
|
|
unsigned long map_offset;
|
|
|
|
unsigned long page_offset;
|
|
|
|
struct page *page;
|
|
|
|
|
2005-09-24 22:28:13 -06:00
|
|
|
if (!entry)
|
2008-02-06 23:20:50 -07:00
|
|
|
return VM_FAULT_SIGBUS; /* Error */
|
2005-09-24 22:28:13 -06:00
|
|
|
if (!entry->pagelist)
|
2008-02-06 23:20:50 -07:00
|
|
|
return VM_FAULT_SIGBUS; /* Nothing allocated */
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2008-02-06 23:20:50 -07:00
|
|
|
offset = (unsigned long)vmf->virtual_address - vma->vm_start;
|
2005-08-05 06:11:22 -06:00
|
|
|
map_offset = map->offset - (unsigned long)dev->sg->virtual;
|
2005-04-16 16:20:36 -06:00
|
|
|
page_offset = (offset >> PAGE_SHIFT) + (map_offset >> PAGE_SHIFT);
|
|
|
|
page = entry->pagelist[page_offset];
|
|
|
|
get_page(page);
|
2008-02-06 23:20:50 -07:00
|
|
|
vmf->page = page;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2008-02-06 23:20:50 -07:00
|
|
|
return 0;
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
|
|
|
|
2008-02-06 23:20:50 -07:00
|
|
|
static int drm_vm_fault(struct vm_area_struct *vma, struct vm_fault *vmf)
|
2005-09-24 22:28:13 -06:00
|
|
|
{
|
2008-02-06 23:20:50 -07:00
|
|
|
return drm_do_vm_fault(vma, vmf);
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
|
|
|
|
2008-02-06 23:20:50 -07:00
|
|
|
static int drm_vm_shm_fault(struct vm_area_struct *vma, struct vm_fault *vmf)
|
2005-09-24 22:28:13 -06:00
|
|
|
{
|
2008-02-06 23:20:50 -07:00
|
|
|
return drm_do_vm_shm_fault(vma, vmf);
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
|
|
|
|
2008-02-06 23:20:50 -07:00
|
|
|
static int drm_vm_dma_fault(struct vm_area_struct *vma, struct vm_fault *vmf)
|
2005-09-24 22:28:13 -06:00
|
|
|
{
|
2008-02-06 23:20:50 -07:00
|
|
|
return drm_do_vm_dma_fault(vma, vmf);
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
|
|
|
|
2008-02-06 23:20:50 -07:00
|
|
|
static int drm_vm_sg_fault(struct vm_area_struct *vma, struct vm_fault *vmf)
|
2005-09-24 22:28:13 -06:00
|
|
|
{
|
2008-02-06 23:20:50 -07:00
|
|
|
return drm_do_vm_sg_fault(vma, vmf);
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
|
|
|
|
|
|
|
/** AGP virtual memory operations */
|
2009-09-27 12:29:37 -06:00
|
|
|
static const struct vm_operations_struct drm_vm_ops = {
|
2008-02-06 23:20:50 -07:00
|
|
|
.fault = drm_vm_fault,
|
2005-09-24 22:28:13 -06:00
|
|
|
.open = drm_vm_open,
|
|
|
|
.close = drm_vm_close,
|
2005-04-16 16:20:36 -06:00
|
|
|
};
|
|
|
|
|
|
|
|
/** Shared virtual memory operations */
|
2009-09-27 12:29:37 -06:00
|
|
|
static const struct vm_operations_struct drm_vm_shm_ops = {
|
2008-02-06 23:20:50 -07:00
|
|
|
.fault = drm_vm_shm_fault,
|
2005-09-24 22:28:13 -06:00
|
|
|
.open = drm_vm_open,
|
|
|
|
.close = drm_vm_shm_close,
|
2005-04-16 16:20:36 -06:00
|
|
|
};
|
|
|
|
|
|
|
|
/** DMA virtual memory operations */
|
2009-09-27 12:29:37 -06:00
|
|
|
static const struct vm_operations_struct drm_vm_dma_ops = {
|
2008-02-06 23:20:50 -07:00
|
|
|
.fault = drm_vm_dma_fault,
|
2005-09-24 22:28:13 -06:00
|
|
|
.open = drm_vm_open,
|
|
|
|
.close = drm_vm_close,
|
2005-04-16 16:20:36 -06:00
|
|
|
};
|
|
|
|
|
|
|
|
/** Scatter-gather virtual memory operations */
|
2009-09-27 12:29:37 -06:00
|
|
|
static const struct vm_operations_struct drm_vm_sg_ops = {
|
2008-02-06 23:20:50 -07:00
|
|
|
.fault = drm_vm_sg_fault,
|
2005-09-24 22:28:13 -06:00
|
|
|
.open = drm_vm_open,
|
|
|
|
.close = drm_vm_close,
|
2005-04-16 16:20:36 -06:00
|
|
|
};
|
|
|
|
|
|
|
|
/**
|
|
|
|
* \c open method for shared virtual memory.
|
2005-09-24 22:28:13 -06:00
|
|
|
*
|
2005-04-16 16:20:36 -06:00
|
|
|
* \param vma virtual memory area.
|
2005-09-24 22:28:13 -06:00
|
|
|
*
|
2005-04-16 16:20:36 -06:00
|
|
|
* Create a new drm_vma_entry structure as the \p vma private data entry and
|
|
|
|
* add it to drm_device::vmalist.
|
|
|
|
*/
|
2008-11-05 11:31:53 -07:00
|
|
|
void drm_vm_open_locked(struct vm_area_struct *vma)
|
2005-04-16 16:20:36 -06:00
|
|
|
{
|
2007-07-10 23:53:27 -06:00
|
|
|
struct drm_file *priv = vma->vm_file->private_data;
|
2008-04-21 00:47:32 -06:00
|
|
|
struct drm_device *dev = priv->minor->dev;
|
2007-07-11 00:21:47 -06:00
|
|
|
struct drm_vma_entry *vma_entry;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
|
|
|
DRM_DEBUG("0x%08lx,0x%08lx\n",
|
|
|
|
vma->vm_start, vma->vm_end - vma->vm_start);
|
|
|
|
atomic_inc(&dev->vma_count);
|
|
|
|
|
2009-03-24 13:23:04 -06:00
|
|
|
vma_entry = kmalloc(sizeof(*vma_entry), GFP_KERNEL);
|
2005-04-16 16:20:36 -06:00
|
|
|
if (vma_entry) {
|
2005-09-24 22:28:13 -06:00
|
|
|
vma_entry->vma = vma;
|
|
|
|
vma_entry->pid = current->pid;
|
2007-05-25 13:01:51 -06:00
|
|
|
list_add(&vma_entry->head, &dev->vmalist);
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
|
|
|
}
|
|
|
|
|
2007-03-24 00:52:49 -06:00
|
|
|
static void drm_vm_open(struct vm_area_struct *vma)
|
|
|
|
{
|
2007-07-10 23:53:27 -06:00
|
|
|
struct drm_file *priv = vma->vm_file->private_data;
|
2008-04-21 00:47:32 -06:00
|
|
|
struct drm_device *dev = priv->minor->dev;
|
2007-03-24 00:52:49 -06:00
|
|
|
|
|
|
|
mutex_lock(&dev->struct_mutex);
|
|
|
|
drm_vm_open_locked(vma);
|
|
|
|
mutex_unlock(&dev->struct_mutex);
|
|
|
|
}
|
|
|
|
|
2010-09-27 14:28:30 -06:00
|
|
|
void drm_vm_close_locked(struct vm_area_struct *vma)
|
2005-04-16 16:20:36 -06:00
|
|
|
{
|
2007-07-10 23:53:27 -06:00
|
|
|
struct drm_file *priv = vma->vm_file->private_data;
|
2008-04-21 00:47:32 -06:00
|
|
|
struct drm_device *dev = priv->minor->dev;
|
2007-07-11 00:21:47 -06:00
|
|
|
struct drm_vma_entry *pt, *temp;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
|
|
|
DRM_DEBUG("0x%08lx,0x%08lx\n",
|
|
|
|
vma->vm_start, vma->vm_end - vma->vm_start);
|
|
|
|
atomic_dec(&dev->vma_count);
|
|
|
|
|
2007-05-25 13:01:51 -06:00
|
|
|
list_for_each_entry_safe(pt, temp, &dev->vmalist, head) {
|
2005-04-16 16:20:36 -06:00
|
|
|
if (pt->vma == vma) {
|
2007-05-25 13:01:51 -06:00
|
|
|
list_del(&pt->head);
|
2009-03-24 13:23:04 -06:00
|
|
|
kfree(pt);
|
2005-04-16 16:20:36 -06:00
|
|
|
break;
|
|
|
|
}
|
|
|
|
}
|
2010-09-27 14:28:30 -06:00
|
|
|
}
|
|
|
|
|
|
|
|
/**
|
|
|
|
* \c close method for all virtual memory types.
|
|
|
|
*
|
|
|
|
* \param vma virtual memory area.
|
|
|
|
*
|
|
|
|
* Search the \p vma private data entry in drm_device::vmalist, unlink it, and
|
|
|
|
* free it.
|
|
|
|
*/
|
|
|
|
static void drm_vm_close(struct vm_area_struct *vma)
|
|
|
|
{
|
|
|
|
struct drm_file *priv = vma->vm_file->private_data;
|
|
|
|
struct drm_device *dev = priv->minor->dev;
|
|
|
|
|
|
|
|
mutex_lock(&dev->struct_mutex);
|
|
|
|
drm_vm_close_locked(vma);
|
2006-02-02 01:37:46 -07:00
|
|
|
mutex_unlock(&dev->struct_mutex);
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
|
|
|
|
|
|
|
/**
|
|
|
|
* mmap DMA memory.
|
|
|
|
*
|
2007-08-25 04:23:09 -06:00
|
|
|
* \param file_priv DRM file private.
|
2005-04-16 16:20:36 -06:00
|
|
|
* \param vma virtual memory area.
|
|
|
|
* \return zero on success or a negative number on failure.
|
2005-09-24 22:28:13 -06:00
|
|
|
*
|
2005-04-16 16:20:36 -06:00
|
|
|
* Sets the virtual memory area operations structure to vm_dma_ops, the file
|
|
|
|
* pointer, and calls vm_open().
|
|
|
|
*/
|
2005-07-07 05:03:38 -06:00
|
|
|
static int drm_mmap_dma(struct file *filp, struct vm_area_struct *vma)
|
2005-04-16 16:20:36 -06:00
|
|
|
{
|
2007-07-10 23:53:27 -06:00
|
|
|
struct drm_file *priv = filp->private_data;
|
|
|
|
struct drm_device *dev;
|
2007-07-11 00:32:08 -06:00
|
|
|
struct drm_device_dma *dma;
|
2005-09-24 22:28:13 -06:00
|
|
|
unsigned long length = vma->vm_end - vma->vm_start;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2008-04-21 00:47:32 -06:00
|
|
|
dev = priv->minor->dev;
|
2005-09-24 22:28:13 -06:00
|
|
|
dma = dev->dma;
|
2007-02-07 22:14:05 -07:00
|
|
|
DRM_DEBUG("start = 0x%lx, end = 0x%lx, page offset = 0x%lx\n",
|
|
|
|
vma->vm_start, vma->vm_end, vma->vm_pgoff);
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2005-09-24 22:28:13 -06:00
|
|
|
/* Length must match exact page count */
|
2005-04-16 16:20:36 -06:00
|
|
|
if (!dma || (length >> PAGE_SHIFT) != dma->page_count) {
|
|
|
|
return -EINVAL;
|
|
|
|
}
|
|
|
|
|
2006-10-24 13:03:04 -06:00
|
|
|
if (!capable(CAP_SYS_ADMIN) &&
|
|
|
|
(dma->flags & _DRM_DMA_USE_PCI_RO)) {
|
|
|
|
vma->vm_flags &= ~(VM_WRITE | VM_MAYWRITE);
|
|
|
|
#if defined(__i386__) || defined(__x86_64__)
|
|
|
|
pgprot_val(vma->vm_page_prot) &= ~_PAGE_RW;
|
|
|
|
#else
|
|
|
|
/* Ye gads this is ugly. With more thought
|
|
|
|
we could move this up higher and use
|
|
|
|
`protection_map' instead. */
|
|
|
|
vma->vm_page_prot =
|
|
|
|
__pgprot(pte_val
|
|
|
|
(pte_wrprotect
|
|
|
|
(__pte(pgprot_val(vma->vm_page_prot)))));
|
|
|
|
#endif
|
|
|
|
}
|
|
|
|
|
2005-09-24 22:28:13 -06:00
|
|
|
vma->vm_ops = &drm_vm_dma_ops;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2005-09-24 22:28:13 -06:00
|
|
|
vma->vm_flags |= VM_RESERVED; /* Don't swap */
|
2008-02-01 19:08:53 -07:00
|
|
|
vma->vm_flags |= VM_DONTEXPAND;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2007-03-24 00:52:49 -06:00
|
|
|
drm_vm_open_locked(vma);
|
2005-04-16 16:20:36 -06:00
|
|
|
return 0;
|
|
|
|
}
|
|
|
|
|
2010-08-23 14:53:28 -06:00
|
|
|
static resource_size_t drm_core_get_reg_ofs(struct drm_device *dev)
|
2005-04-16 16:20:36 -06:00
|
|
|
{
|
|
|
|
#ifdef __alpha__
|
2011-06-09 16:18:39 -06:00
|
|
|
return dev->hose->dense_mem_base;
|
2005-04-16 16:20:36 -06:00
|
|
|
#else
|
|
|
|
return 0;
|
|
|
|
#endif
|
|
|
|
}
|
2005-09-24 22:28:13 -06:00
|
|
|
|
2005-04-16 16:20:36 -06:00
|
|
|
/**
|
|
|
|
* mmap DMA memory.
|
|
|
|
*
|
2007-08-25 04:23:09 -06:00
|
|
|
* \param file_priv DRM file private.
|
2005-04-16 16:20:36 -06:00
|
|
|
* \param vma virtual memory area.
|
|
|
|
* \return zero on success or a negative number on failure.
|
2005-09-24 22:28:13 -06:00
|
|
|
*
|
2005-04-16 16:20:36 -06:00
|
|
|
* If the virtual memory area has no offset associated with it then it's a DMA
|
|
|
|
* area, so calls mmap_dma(). Otherwise searches the map in drm_device::maplist,
|
|
|
|
* checks that the restricted flag is not set, sets the virtual memory operations
|
|
|
|
* according to the mapping type and remaps the pages. Finally sets the file
|
|
|
|
* pointer and calls vm_open().
|
|
|
|
*/
|
2008-11-05 11:31:53 -07:00
|
|
|
int drm_mmap_locked(struct file *filp, struct vm_area_struct *vma)
|
2005-04-16 16:20:36 -06:00
|
|
|
{
|
2007-07-10 23:53:27 -06:00
|
|
|
struct drm_file *priv = filp->private_data;
|
2008-04-21 00:47:32 -06:00
|
|
|
struct drm_device *dev = priv->minor->dev;
|
2009-02-01 22:55:46 -07:00
|
|
|
struct drm_local_map *map = NULL;
|
2009-02-01 22:55:47 -07:00
|
|
|
resource_size_t offset = 0;
|
2007-07-11 18:26:44 -06:00
|
|
|
struct drm_hash_item *hash;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2007-02-07 22:14:05 -07:00
|
|
|
DRM_DEBUG("start = 0x%lx, end = 0x%lx, page offset = 0x%lx\n",
|
|
|
|
vma->vm_start, vma->vm_end, vma->vm_pgoff);
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2005-09-24 22:28:13 -06:00
|
|
|
if (!priv->authenticated)
|
|
|
|
return -EACCES;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
|
|
|
/* We check for "dma". On Apple's UniNorth, it's valid to have
|
|
|
|
* the AGP mapped at physical address 0
|
|
|
|
* --BenH.
|
|
|
|
*/
|
2007-02-07 22:14:05 -07:00
|
|
|
if (!vma->vm_pgoff
|
2005-04-16 16:20:36 -06:00
|
|
|
#if __OS_HAS_AGP
|
2005-09-24 22:28:13 -06:00
|
|
|
&& (!dev->agp
|
|
|
|
|| dev->agp->agp_info.device->vendor != PCI_VENDOR_ID_APPLE)
|
2005-04-16 16:20:36 -06:00
|
|
|
#endif
|
|
|
|
)
|
|
|
|
return drm_mmap_dma(filp, vma);
|
|
|
|
|
2007-02-07 22:14:05 -07:00
|
|
|
if (drm_ht_find_item(&dev->map_hash, vma->vm_pgoff, &hash)) {
|
2006-08-07 06:36:47 -06:00
|
|
|
DRM_ERROR("Could not find map\n");
|
|
|
|
return -EINVAL;
|
2005-04-16 16:20:36 -06:00
|
|
|
}
|
|
|
|
|
2007-07-11 00:53:40 -06:00
|
|
|
map = drm_hash_entry(hash, struct drm_map_list, hash)->map;
|
2005-09-24 22:28:13 -06:00
|
|
|
if (!map || ((map->flags & _DRM_RESTRICTED) && !capable(CAP_SYS_ADMIN)))
|
2005-04-16 16:20:36 -06:00
|
|
|
return -EPERM;
|
|
|
|
|
2005-09-24 22:28:13 -06:00
|
|
|
/* Check for valid size. */
|
2007-02-09 18:07:47 -07:00
|
|
|
if (map->size < vma->vm_end - vma->vm_start)
|
2005-09-24 22:28:13 -06:00
|
|
|
return -EINVAL;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
|
|
|
if (!capable(CAP_SYS_ADMIN) && (map->flags & _DRM_READ_ONLY)) {
|
|
|
|
vma->vm_flags &= ~(VM_WRITE | VM_MAYWRITE);
|
|
|
|
#if defined(__i386__) || defined(__x86_64__)
|
|
|
|
pgprot_val(vma->vm_page_prot) &= ~_PAGE_RW;
|
|
|
|
#else
|
2005-09-24 22:28:13 -06:00
|
|
|
/* Ye gads this is ugly. With more thought
|
|
|
|
we could move this up higher and use
|
|
|
|
`protection_map' instead. */
|
|
|
|
vma->vm_page_prot =
|
|
|
|
__pgprot(pte_val
|
|
|
|
(pte_wrprotect
|
|
|
|
(__pte(pgprot_val(vma->vm_page_prot)))));
|
2005-04-16 16:20:36 -06:00
|
|
|
#endif
|
|
|
|
}
|
|
|
|
|
|
|
|
switch (map->type) {
|
2010-05-27 13:40:26 -06:00
|
|
|
#if !defined(__arm__)
|
2005-09-24 22:28:13 -06:00
|
|
|
case _DRM_AGP:
|
|
|
|
if (drm_core_has_AGP(dev) && dev->agp->cant_use_aperture) {
|
|
|
|
/*
|
|
|
|
* On some platforms we can't talk to bus dma address from the CPU, so for
|
|
|
|
* memory of type DRM_AGP, we'll deal with sorting out the real physical
|
2008-02-06 23:20:50 -07:00
|
|
|
* pages and mappings in fault()
|
2005-09-24 22:28:13 -06:00
|
|
|
*/
|
2005-04-16 16:20:36 -06:00
|
|
|
#if defined(__powerpc__)
|
2005-09-24 22:28:13 -06:00
|
|
|
pgprot_val(vma->vm_page_prot) |= _PAGE_NO_CACHE;
|
2005-04-16 16:20:36 -06:00
|
|
|
#endif
|
2005-09-24 22:28:13 -06:00
|
|
|
vma->vm_ops = &drm_vm_ops;
|
|
|
|
break;
|
|
|
|
}
|
|
|
|
/* fall through to _DRM_FRAME_BUFFER... */
|
2010-05-27 13:40:26 -06:00
|
|
|
#endif
|
2005-04-16 16:20:36 -06:00
|
|
|
case _DRM_FRAME_BUFFER:
|
|
|
|
case _DRM_REGISTERS:
|
2010-08-23 14:53:28 -06:00
|
|
|
offset = drm_core_get_reg_ofs(dev);
|
2007-02-09 17:53:13 -07:00
|
|
|
vma->vm_flags |= VM_IO; /* not in core dump */
|
|
|
|
vma->vm_page_prot = drm_io_prot(map->type, vma);
|
2010-05-27 13:40:26 -06:00
|
|
|
#if !defined(__arm__)
|
2006-08-07 04:07:43 -06:00
|
|
|
if (io_remap_pfn_range(vma, vma->vm_start,
|
2005-09-24 22:28:13 -06:00
|
|
|
(map->offset + offset) >> PAGE_SHIFT,
|
|
|
|
vma->vm_end - vma->vm_start,
|
|
|
|
vma->vm_page_prot))
|
|
|
|
return -EAGAIN;
|
2010-05-27 13:40:26 -06:00
|
|
|
#else
|
|
|
|
if (remap_pfn_range(vma, vma->vm_start,
|
|
|
|
(map->offset + offset) >> PAGE_SHIFT,
|
|
|
|
vma->vm_end - vma->vm_start,
|
|
|
|
vma->vm_page_prot))
|
|
|
|
return -EAGAIN;
|
|
|
|
#endif
|
|
|
|
|
2005-04-16 16:20:36 -06:00
|
|
|
DRM_DEBUG(" Type = %d; start = 0x%lx, end = 0x%lx,"
|
2009-02-01 22:55:47 -07:00
|
|
|
" offset = 0x%llx\n",
|
2005-04-16 16:20:36 -06:00
|
|
|
map->type,
|
2009-02-01 22:55:47 -07:00
|
|
|
vma->vm_start, vma->vm_end, (unsigned long long)(map->offset + offset));
|
2010-05-27 13:40:26 -06:00
|
|
|
|
2005-04-16 16:20:36 -06:00
|
|
|
vma->vm_ops = &drm_vm_ops;
|
|
|
|
break;
|
2005-07-09 22:34:13 -06:00
|
|
|
case _DRM_CONSISTENT:
|
2007-03-24 00:55:16 -06:00
|
|
|
/* Consistent memory is really like shared memory. But
|
2008-02-06 23:20:50 -07:00
|
|
|
* it's allocated in a different way, so avoid fault */
|
2007-03-24 00:55:16 -06:00
|
|
|
if (remap_pfn_range(vma, vma->vm_start,
|
|
|
|
page_to_pfn(virt_to_page(map->handle)),
|
|
|
|
vma->vm_end - vma->vm_start, vma->vm_page_prot))
|
|
|
|
return -EAGAIN;
|
2008-03-28 15:23:07 -06:00
|
|
|
vma->vm_page_prot = drm_dma_prot(map->type, vma);
|
2007-03-24 00:55:16 -06:00
|
|
|
/* fall through to _DRM_SHM */
|
|
|
|
case _DRM_SHM:
|
2005-04-16 16:20:36 -06:00
|
|
|
vma->vm_ops = &drm_vm_shm_ops;
|
|
|
|
vma->vm_private_data = (void *)map;
|
2005-09-24 22:28:13 -06:00
|
|
|
/* Don't let this area swap. Change when
|
|
|
|
DRM_KERNEL advisory is supported. */
|
2005-04-16 16:20:36 -06:00
|
|
|
vma->vm_flags |= VM_RESERVED;
|
|
|
|
break;
|
|
|
|
case _DRM_SCATTER_GATHER:
|
|
|
|
vma->vm_ops = &drm_vm_sg_ops;
|
|
|
|
vma->vm_private_data = (void *)map;
|
|
|
|
vma->vm_flags |= VM_RESERVED;
|
2008-04-19 18:26:25 -06:00
|
|
|
vma->vm_page_prot = drm_dma_prot(map->type, vma);
|
2005-09-24 22:28:13 -06:00
|
|
|
break;
|
2005-04-16 16:20:36 -06:00
|
|
|
default:
|
|
|
|
return -EINVAL; /* This should never happen. */
|
|
|
|
}
|
2005-09-24 22:28:13 -06:00
|
|
|
vma->vm_flags |= VM_RESERVED; /* Don't swap */
|
2008-02-01 19:08:53 -07:00
|
|
|
vma->vm_flags |= VM_DONTEXPAND;
|
2005-04-16 16:20:36 -06:00
|
|
|
|
2007-03-24 00:52:49 -06:00
|
|
|
drm_vm_open_locked(vma);
|
2005-04-16 16:20:36 -06:00
|
|
|
return 0;
|
|
|
|
}
|
2005-09-24 22:28:13 -06:00
|
|
|
|
2007-03-24 00:52:49 -06:00
|
|
|
int drm_mmap(struct file *filp, struct vm_area_struct *vma)
|
|
|
|
{
|
2007-07-10 23:53:27 -06:00
|
|
|
struct drm_file *priv = filp->private_data;
|
2008-04-21 00:47:32 -06:00
|
|
|
struct drm_device *dev = priv->minor->dev;
|
2007-03-24 00:52:49 -06:00
|
|
|
int ret;
|
|
|
|
|
|
|
|
mutex_lock(&dev->struct_mutex);
|
|
|
|
ret = drm_mmap_locked(filp, vma);
|
|
|
|
mutex_unlock(&dev->struct_mutex);
|
|
|
|
|
|
|
|
return ret;
|
|
|
|
}
|
2005-04-16 16:20:36 -06:00
|
|
|
EXPORT_SYMBOL(drm_mmap);
|