Instance reachability check failed, can't access the instance

0

from last 24 hr, the ec2 instance is not working, on console it is showing "Instance reachability check failed". i already tried all possible ways as documented on https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/TroubleshootingInstances.html

i also checked the system logs as followed, but seems all fine. i also get the instance screenshot as below

please let me know what should i do next. thanks

nikhil
asked 12 days ago125 views
2 Answers
0

Hello

Please check the link from the repost which have more detailed information for the debugging this issue https://repost.aws/knowledge-center/ec2-linux-status-check-failure

Possible alternatives from My Side:

Reboot the instance: A simple reboot can sometimes resolve temporary network or software glitches that might be preventing the reachability check.

Backup and Terminate --> relaunch the instance: If none of the above steps work,

  • You can create AMI from the instance wait until it finishes the creation of AMI. Then relaunch new instance with AMI.
  • If you have EIP you can re-associate with the new instance
  • If all works terminate the old one.
profile picture
GK
answered 12 days ago
profile pictureAWS
EXPERT
reviewed 12 days ago
  • Thanks for the reply, i have tried to create the new instance using AMI, but it also failed the "Instance reachability check". also i have checked the system logs. But all looks fine. Now, i have no idea how can i find the reason of failure. please let me know if there is any way. here are the logs.

    [ 0.000000] platform_pci_unplug: Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs. [ 0.000000] platform_pci_unplug: Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks. [ 0.000000] You might have to change the root device [ 0.000000] from /dev/hd[a-d] to /dev/xvd[a-d] [ 0.000000] in your root= kernel command line option [ 0.021904] tsc: Fast TSC calibration using PIT

0

Thanks for the reply, i have tried to create the new instance using AMI, but it also failed the "Instance reachability check". also i have checked the system logs. But all looks fine. Now, i have no idea how can i find the reason of failure. please let me know if there is any way. here are the logs.

[    0.000000] Linux version 5.15.0-1058-aws (buildd@lcy02-amd64-094) (gcc (Ubuntu 9.4.0-1ubuntu1~20.04.2) 9.4.0, GNU ld (GNU Binutils for Ubuntu) 2.34) #64~20.04.1-Ubuntu SMP Tue Apr 9 11:12:27 UTC 2024 (Ubuntu 5.15.0-1058.64~20.04.1-aws 5.15.148)
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-1058-aws root=PARTUUID=4986e35b-1bd5-45d3-b528-fa2edb861a38 ro console=tty1 console=ttyS0 nvme_core.io_timeout=4294967295 panic=-1
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Hygon HygonGenuine
[    0.000000]   Centaur CentaurHauls
[    0.000000]   zhaoxin   Shanghai  
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009e000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003fffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000fc000000-0x00000000ffffffff] reserved
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.7 present.
[    0.000000] DMI: Xen HVM domU, BIOS 4.11.amazon 08/24/2006
[    0.000000] Hypervisor detected: Xen HVM
[    0.000000] Xen version 4.11.
[    0.000000] platform_pci_unplug: Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs.
[    0.000000] platform_pci_unplug: Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks.
[    0.000000] You might have to change the root device
[    0.000000] from /dev/hd[a-d] to /dev/xvd[a-d]
[    0.000000] in your root= kernel command line option
[    0.021904] tsc: Fast TSC calibration using PIT
[    0.021909] tsc: Detected 2400.112 MHz processor
[    0.021911] tsc: Detected 2400.024 MHz TSC
[    0.022363] last_pfn = 0x40000 max_arch_pfn = 0x400000000
[    0.022407] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.029766] found SMP MP-table at [mem 0x000fb9a0-0x000fb9af]
[    0.029921] RAMDISK: [mem 0x37209000-0x378fbfff]
[    0.029926] ACPI: Early table checksum verification disabled
[    0.029930] ACPI: RSDP 0x00000000000EA020 000024 (v02 Xen   )
[    0.029936] ACPI: XSDT 0x00000000FC00C780 000054 (v01 Xen    HVM      00000000 HVML 00000000)
[    0.029943] ACPI: FACP 0x00000000FC00C440 0000F4 (v04 Xen    HVM      00000000 HVML 00000000)
[    0.029950] ACPI: DSDT 0x00000000FC003940 008A7E (v02 Xen    HVM      00000000 INTL 20090123)
[    0.029954] ACPI: FACS 0x00000000FC003900 000040
[    0.029958] ACPI: FACS 0x00000000FC003900 000040
[    0.029961] ACPI: APIC 0x00000000FC00C540 0000D8 (v02 Xen    HVM      00000000 HVML 00000000)
[    0.029966] ACPI: HPET 0x00000000FC00C690 000038 (v01 Xen    HVM      00000000 HVML 00000000)
[    0.029970] ACPI: WAET 0x00000000FC00C6D0 000028 (v01 Xen    HVM      00000000 HVML 00000000)
[    0.029974] ACPI: SSDT 0x00000000FC00C700 000031 (v02 Xen    HVM      00000000 INTL 20090123)
[    0.029978] ACPI: SSDT 0x00000000FC00C740 000033 (v02 Xen    HVM      00000000 INTL 20090123)
[    0.029981] ACPI: Reserving FACP table memory at [mem 0xfc00c440-0xfc00c533]
[    0.029983] ACPI: Reserving DSDT table memory at [mem 0xfc003940-0xfc00c3bd]
[    0.029985] ACPI: Reserving FACS table memory at [mem 0xfc003900-0xfc00393f]
[    0.029986] ACPI: Reserving FACS table memory at [mem 0xfc003900-0xfc00393f]
[    0.029987] ACPI: Reserving APIC table memory at [mem 0xfc00c540-0xfc00c617]
[    0.029989] ACPI: Reserving HPET table memory at [mem 0xfc00c690-0xfc00c6c7]
[    0.029990] ACPI: Reserving WAET table memory at [mem 0xfc00c6d0-0xfc00c6f7]
[    0.029991] ACPI: Reserving SSDT table memory at [mem 0xfc00c700-0xfc00c730]
[    0.029993] ACPI: Reserving SSDT table memory at [mem 0xfc00c740-0xfc00c772]
[    0.031728] No NUMA configuration found
[    0.031731] Faking a node at [mem 0x0000000000000000-0x000000003fffffff]
[    0.031742] NODE_DATA(0) allocated [mem 0x3ffd6000-0x3fffffff]
[    0.032045] Zone ranges:
[    0.032046]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.032048]   DMA32    [mem 0x0000000001000000-0x000000003fffffff]
[    0.032051]   Normal   empty
[    0.032052]   Device   empty
[    0.032054] Movable zone start for each node
[    0.032058] Early memory node ranges
[    0.032058]   node   0: [mem 0x0000000000001000-0x000000000009dfff]
[    0.032060]   node   0: [mem 0x0000000000100000-0x000000003fffffff]
[    0.032062] Initmem setup node 0 [mem 0x0000000000001000-0x000000003fffffff]
[    0.032067] On node 0, zone DMA: 1 pages in unavailable ranges
[    0.032098] On node 0, zone DMA: 98 pages in unavailable ranges
[    0.036324] ACPI: PM-Timer IO Port: 0xb008
[    0.036386] IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47
[    0.036390] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.036393] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level)
[    0.036395] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)
[    0.036396] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)
[    0.036400] ACPI: Using ACPI (MADT) for SMP configuration information
[    0.036402] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.036407] TSC deadline timer available
[    0.036416] smpboot: Allowing 15 CPUs, 14 hotplug CPUs
[    0.036426] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.036429] PM: hibernation: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
[    0.036430] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.036432] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.036434] [mem 0x40000000-0xfbffffff] available for PCI devices
[    0.036436] Booting paravirtualized kernel on Xen HVM
[    0.036439] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[    0.036447] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:15 nr_cpu_ids:15 nr_node_ids:1
[    0.037265] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144
[    0.037320] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)
[    0.037327] Built 1 zonelists, mobility grouping on.  Total pages: 257792
[    0.037329] Policy zone: DMA32
[    0.037331] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-1058-aws root=PARTUUID=4986e35b-1bd5-45d3-b528-fa2edb861a38 ro console=tty1 console=ttyS0 nvme_core.io_timeout=4294967295 panic=-1
[    0.037411] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-1058-aws", will be passed to user space.
[    0.037562] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.037643] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.037859] mem auto-init: stack:off, heap alloc:on, heap free:off
[    0.040300] Memory: 960840K/1048180K available (16393K kernel code, 4397K rwdata, 10916K rodata, 3360K init, 18708K bss, 87080K reserved, 0K cma-reserved)
[    0.040676] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=15, Nodes=1
[    0.040696] Kernel/User page tables isolation: enabled
[    0.040735] ftrace: allocating 50378 entries in 197 pages
[    0.067814] ftrace: allocated 197 pages with 4 groups
[    0.068016] rcu: Hierarchical RCU implementation.
[    0.068018] rcu: 	RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=15.
[    0.068020] 	Rude variant of Tasks RCU enabled.
[    0.068021] 	Tracing variant of Tasks RCU enabled.
[    0.068023] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.068024] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=15
[    0.072789] NR_IRQS: 524544, nr_irqs: 952, preallocated irqs: 16
[    0.072825] xen:events: Using 2-level ABI
[    0.072886] xen:events: Xen HVM callback vector for event delivery is enabled
[    0.073045] random: crng init done
[    0.179470] Console: colour VGA+ 80x25
[    0.301506] printk: console [tty1] enabled
[    0.302563] Cannot get hvm parameter CONSOLE_EVTCHN (18): -22!
[    0.953822] printk: console [ttyS0] enabled
[    0.957436] ACPI: Core revision 20210730
[    0.961463] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 30580167144 ns
[    0.969338] APIC: Switch to symmetric I/O mode setup
[    0.973911] x2apic: IRQ remapping doesn't support X2APIC mode
[    0.979461] Switched APIC routing to physical flat.
[    0.986063] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0
[    1.010345] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22984df774b, max_idle_ns: 440795211062 ns
[    1.020013] Calibrating delay loop (skipped), value calculated using timer frequency.. 4800.04 BogoMIPS (lpj=9600096)
[    1.028126] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024
[    1.036008] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4
[    1.040014] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    1.048010] Spectre V2 : Mitigation: Retpolines
[    1.052010] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    1.064008] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT
[    1.072009] Speculative Store Bypass: Vulnerable
[    1.076019] MDS: Vulnerable: Clear CPU buffers attempted, no microcode
[    1.084009] MMIO Stale Data: Vulnerable: Clear CPU buffers attempted, no microcode
[    1.092030] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    1.100008] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    1.108008] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    1.116010] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    1.124008] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[    1.157312] pid_max: default: 32768 minimum: 301
[    1.160063] LSM: Security Framework initializing
[    1.168027] landlock: Up and running.
[    1.171017] Yama: becoming mindful.
[    1.172046] AppArmor: AppArmor initialized
[    1.176056] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes, linear)
[    1.184011] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes, linear)
[    1.188379] clocksource: xen: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[    1.200038] installing Xen timer for CPU 0
[    1.203827] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2676 v3 @ 2.40GHz (family: 0x6, model: 0x3f, stepping: 0x2)
[    1.204066] cpu 0 spinlock event irq 53
[    1.208022] Performance Events: unsupported p6 CPU model 63 no PMU driver, software events only.
[    1.212036] signal: max sigframe size: 1776
[    1.215658] rcu: Hierarchical SRCU implementation.
[    1.216482] NMI watchdog: Perf NMI watchdog permanently disabled
[    1.220235] smp: Bringing up secondary CPUs ...
[    1.224015] smp: Brought up 1 node, 1 CPU
[    1.227785] smpboot: Max logical packages: 15
[    1.228018] smpboot: Total of 1 processors activated (4800.04 BogoMIPS)
[    1.232293] devtmpfs: initialized
[    1.236067] x86/mm: Memory block size: 128MB
[    1.240083] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    1.244071] futex hash table entries: 4096 (order: 6, 262144 bytes, linear)
[    1.248125] pinctrl core: initialized pinctrl subsystem
[    1.252151] PM: RTC time: 18:03:27, date: 2024-04-23
[    1.256232] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    1.260171] DMA: preallocated 128 KiB GFP_KERNEL pool for atomic allocations
[    1.264041] DMA: preallocated 128 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    1.268049] DMA: preallocated 128 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    1.272035] audit: initializing netlink subsys (disabled)
[    1.276260] thermal_sys: Registered thermal governor 'fair_share'
[    1.276262] thermal_sys: Registered thermal governor 'bang_bang'
[    1.280020] audit: type=2000 audit(1713895407.483:1): state=initialized audit_enabled=0 res=1
[    1.288023] thermal_sys: Registered thermal governor 'step_wise'
[    1.288026] thermal_sys: Registered thermal governor 'user_space'
[    1.292016] thermal_sys: Registered thermal governor 'power_allocator'
[    1.296041] EISA bus registered
[    1.303151] cpuidle: using governor ladder
[    1.304016] cpuidle: using governor menu
[    1.307889] ACPI: bus type PCI registered
[    1.308016] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.312530] PCI: Using configuration type 1 for base access
[    1.317436] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[    1.320179] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    1.325023] ACPI: Added _OSI(Module Device)
[    1.328055] ACPI: Added _OSI(Processor Device)
[    1.332071] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.336028] ACPI: Added _OSI(Processor Aggregator Device)
[    1.340028] ACPI: Added _OSI(Linux-Dell-Video)
[    1.343900] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    1.344020] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    1.353476] ACPI: 3 ACPI AML tables successfully acquired and loaded
[    1.357976] ACPI: Interpreter enabled
[    1.360030] ACPI: PM: (supports S0 S4 S5)
[    1.364013] ACPI: Using IOAPIC for interrupt routing
[    1.368055] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.372014] PCI: Using E820 reservations for host bridge windows
[    1.376438] ACPI: Enabled 2 GPEs in block 00 to 0F
[    1.405891] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    1.408036] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI EDR HPX-Type3]
[    1.412057] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[    1.417311] acpiphp: Slot [0] registered
[    1.421618] acpiphp: Slot [3] registered
[    1.424603] acpiphp: Slot [4] registered
[    1.428617] acpiphp: Slot [5] registered
nikhil
answered 10 days ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions