[Problem] The current Linux cannot migrate pages used by the kerenl because of the kernel direct mapping. In Linux kernel space, va = pa + PAGE_OFFSET. When the pa is changed, we cannot simply update the pagetable and keep the va unmodified. So the kernel pages are not migratable. There are also some other issues will cause the kernel pages not migratable. For example, the physical address may be cached somewhere and will be used. It is not to update all the caches. When doing memory hotplug in Linux, we first migrate all the pages in one memory device somewhere else, and then remove the device. But if pages are used by the kernel, they are not migratable. As a result, memory used by the kernel cannot be hot-removed. Modifying the kernel direct mapping mechanism is too difficult to do. And it may cause the kernel performance down and unstable. So we use the following way to do memory hotplug. [What we are doing] In Linux, memory in one numa node is divided into several zones. One of the zones is ZONE_MOVABLE, which the kernel won't use. In order to implement memory hotplug in Linux, we are going to arrange all hotpluggable memory in ZONE_MOVABLE so that the kernel won't use these memory. To do this, we need ACPI's help. [How we do this] In ACPI, SRAT(System Resource Affinity Table) contains NUMA info. The memory affinities in SRAT record every memory range in the system, and also, flags specifying if the memory range is hotpluggable. (Please refer to ACPI spec 5.0 5.2.16) With the help of SRAT, we have to do the following two things to achieve our goal: 1. When doing memory hot-add, allow the users arranging hotpluggable as ZONE_MOVABLE. (This has been done by the MOVABLE_NODE functionality in Linux.) 2. when the system is booting, prevent bootmem allocator from allocating hotpluggable memory for the kernel before the memory initialization finishes. (This is what we are going to do. And we need to do some modification in ACPICA. See below.) [About this patch-set] There is a bootmem allocator named memblock in Linux. memblock starts to work at very early time, and SRAT has not been parsed. So we don't know which memory is hotpluggable. In order to prevent memblock from allocating hotpluggable memory for the kernel, we need to obtain SRAT memory affinity info earlier. In the current Linux kernel, the acpica code iterates acpi_gbl_root_table_list, and install all the acpi tables into it at boot time. Then, it tries to find if there is any override table in global array acpi_tables_addr. If any, reinstall the override table into acpi_gbl_root_table_list. In Linux, global array acpi_tables_addr can be fulfilled by ACPI_INITRD_TABLE_OVERRIDE mechanism, which allows users to specify their own ACPI tables in initrd file, and override the ones from firmware. The whole procedure looks like the following: setup_arch() |-> ...... /* Setup direct mapping pagetables */ |->acpi_initrd_override() /* Store all override tables in acpi_tables_addr. */ |... |->acpi_boot_table_init() |->acpi_table_init() | (Linux code) ------------------------------------------------------------------------------------------------------- | (ACPICA code) |->acpi_initialize_tables() |->acpi_tb_parse_root_table() /* Parse RSDT or XSDT, find all tables in firmware */ |->for (each item in acpi_gbl_root_table_list) |->acpi_tb_install_table() |-> ...... /* Install one single table */ |->acpi_tb_table_override() /* Override one single table */ It does the table installation and overriding one by one. In order to find SRAT at earlier time, we want to initialize acpi_gbl_root_table_list earlier. But at the same time, keep ACPI_INITRD_TABLE_OVERRIDE procedure works as well. The basic idea is, split the acpi_gbl_root_table_list initialization procedure into two steps: 1. Install all tables from firmware, not one by one. 2. Override any table if necessary, not one by one. After this patch-set, it will work like this: setup_arch() |-> ...... /* Install all tables from firmware (Step 1) */ |-> ...... /* Try to find if any override SRAT in initrd file, if yes, use it */ |-> ...... /* Use the SRAT from firmware */ |-> ...... /* memblock starts to work */ |-> ...... |->acpi_initrd_override() /* Initialize acpi_tables_addr with all override table. */ |... |-> ...... /* Do the table override work for all tables (Step 2) */ In order to achieve this goal, we have to split all the following functions: ACPICA: acpi_tb_install_table() acpi_tb_parse_root_table() acpi_initialize_tables() Linux acpi: acpi_table_init() acpi_boot_table_init() Since ACPICA code is not just used by the Linux, so we should keep the ACPICA side interfaces unmodified, and introduce new functions used in Linux. This patch split acpi_tb_install_table() into two steps, and introduce two new functions: acpi_tb_install_table_firmware() and acpi_tb_install_table_override(), which will be used later in Linux. Signed-off-by: Tang Chen <tangchen@xxxxxxxxxxxxxx> Reviewed-by: Zhang Yanfei <zhangyanfei@xxxxxxxxxxxxxx> --- drivers/acpi/acpica/tbutils.c | 118 +++++++++++++++++++++++++++++++++++----- 1 files changed, 103 insertions(+), 15 deletions(-) diff --git a/drivers/acpi/acpica/tbutils.c b/drivers/acpi/acpica/tbutils.c index bffdfc7..2db068c 100644 --- a/drivers/acpi/acpica/tbutils.c +++ b/drivers/acpi/acpica/tbutils.c @@ -249,28 +249,25 @@ struct acpi_table_header *acpi_tb_copy_dsdt(u32 table_index) /******************************************************************************* * - * FUNCTION: acpi_tb_install_table + * FUNCTION: acpi_tb_install_table_firmware * - * PARAMETERS: address - Physical address of DSDT or FACS + * PARAMETERS: address - Physical address of the table to be + * installed * signature - Table signature, NULL if no need to * match * table_index - Index into root table array * * RETURN: None * - * DESCRIPTION: Install an ACPI table into the global data structure. The - * table override mechanism is called to allow the host - * OS to replace any table before it is installed in the root - * table array. + * DESCRIPTION: Install an ACPI table into the global data structure. * ******************************************************************************/ void -acpi_tb_install_table(acpi_physical_address address, - char *signature, u32 table_index) +acpi_tb_install_table_firmware(acpi_physical_address address, + char *signature, u32 table_index) { struct acpi_table_header *table; - struct acpi_table_header *final_table; struct acpi_table_desc *table_desc; if (!address) { @@ -312,6 +309,74 @@ acpi_tb_install_table(acpi_physical_address address, table_desc->flags = ACPI_TABLE_ORIGIN_MAPPED; ACPI_MOVE_32_TO_32(table_desc->signature.ascii, table->signature); + acpi_tb_print_table_header(table_desc->address, table); + + /* Set the global integer width (based upon revision of the DSDT) */ + + if (table_index == ACPI_TABLE_INDEX_DSDT) { + acpi_ut_set_integer_width(table->revision); + } + + unmap_and_exit: + + /* Always unmap the table header that we mapped above */ + + acpi_os_unmap_memory(table, sizeof(struct acpi_table_header)); +} + +/******************************************************************************* + * + * FUNCTION: acpi_tb_install_table_override + * + * PARAMETERS: address - Physical address of the table to be + * installed + * signature - Table signature, NULL if no need to + * match + * table_index - Index into root table array + * + * RETURN: None + * + * DESCRIPTION: Override an ACPI table in the global data structure. + * + ******************************************************************************/ + +void +acpi_tb_install_table_override(acpi_physical_address address, + char *signature, u32 table_index) +{ + struct acpi_table_header *table; + struct acpi_table_header *final_table; + struct acpi_table_desc *table_desc; + + if (!address) { + ACPI_ERROR((AE_INFO, + "Null physical address for ACPI table [%s]", + signature)); + return; + } + + /* Map just the table header */ + + table = acpi_os_map_memory(address, sizeof(struct acpi_table_header)); + if (!table) { + ACPI_ERROR((AE_INFO, + "Could not map memory for table [%s] at %p", + signature, ACPI_CAST_PTR(void, address))); + return; + } + + /* If a particular signature is expected (DSDT/FACS), it must match */ + + if (signature && !ACPI_COMPARE_NAME(table->signature, signature)) { + ACPI_BIOS_ERROR((AE_INFO, + "Invalid signature 0x%X for ACPI table, expected [%s]", + *ACPI_CAST_PTR(u32, table->signature), + signature)); + goto unmap_and_exit; + } + + table_desc = &acpi_gbl_root_table_list.tables[table_index]; + /* * ACPI Table Override: * @@ -332,12 +397,6 @@ acpi_tb_install_table(acpi_physical_address address, acpi_tb_print_table_header(table_desc->address, final_table); - /* Set the global integer width (based upon revision of the DSDT) */ - - if (table_index == ACPI_TABLE_INDEX_DSDT) { - acpi_ut_set_integer_width(final_table->revision); - } - /* * If we have a physical override during this early loading of the ACPI * tables, unmap the table for now. It will be mapped again later when @@ -359,6 +418,35 @@ acpi_tb_install_table(acpi_physical_address address, /******************************************************************************* * + * FUNCTION: acpi_tb_install_table + * + * PARAMETERS: address - Physical address of DSDT or FACS + * signature - Table signature, NULL if no need to + * match + * table_index - Index into root table array + * + * RETURN: None + * + * DESCRIPTION: Install an ACPI table into the global data structure. The + * table override mechanism is called to allow the host + * OS to replace any table which has been installed in the root + * table array. + * + ******************************************************************************/ + +void +acpi_tb_install_table(acpi_physical_address address, + char *signature, u32 table_index) +{ + /* Install a table from firmware into acpi_gbl_root_table_list. */ + acpi_tb_install_table_firmware(address, signature, table_index); + + /* Override an installed table. */ + acpi_tb_install_table_override(address, signature, table_index); +} + +/******************************************************************************* + * * FUNCTION: acpi_tb_get_root_table_entry * * PARAMETERS: table_entry - Pointer to the RSDT/XSDT table entry -- 1.7.1 -- To unsubscribe from this list: send the line "unsubscribe linux-doc" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html