percpu: renew the max_contig if we merge the head and previous block
authorJianyu Zhan <nasa4836@gmail.com>
Fri, 28 Mar 2014 12:55:21 +0000 (20:55 +0800)
committerTejun Heo <tj@kernel.org>
Sat, 29 Mar 2014 13:29:42 +0000 (09:29 -0400)
During pcpu_alloc_area(), we might merge the current head with the
previous block. Since we have calculated the max_contig using the
size of previous block before we skip it, and now we update the size
of previous block, so we should renew the max_contig.

Signed-off-by: Jianyu Zhan <nasa4836@gmail.com>
Signed-off-by: Tejun Heo <tj@kernel.org>
mm/percpu.c

index 202e104df8a7a765d680ca6b18526636a5b12634..63e24fb4387b6d305960f9e7ba8c0554e6818ca5 100644 (file)
@@ -473,9 +473,11 @@ static int pcpu_alloc_area(struct pcpu_chunk *chunk, int size, int align)
                 * uncommon for percpu allocations.
                 */
                if (head && (head < sizeof(int) || !(p[-1] & 1))) {
+                       *p = off += head;
                        if (p[-1] & 1)
                                chunk->free_size -= head;
-                       *p = off += head;
+                       else
+                               max_contig = max(*p - p[-1], max_contig);
                        this_size -= head;
                        head = 0;
                }