After a sudden lost of power I got the following error while trying to connect to the vcenter server:
Internal Server Error
2013-05-15 17:47:44,772 | DEBUG | 23b4fe43-1f29-4c6f-adc1-1048b2a8845cListener (260) | JobManager | **** Add activity log: <JOB_VC_START
_CONNECTION> <cloudvcs0(com.vmware.vcloud.entity.vimserver:23b4fe43-1f29-4c6f-adc1-1048b2a8845c)> |
2013-05-15 17:47:44,773 | DEBUG | 23b4fe43-1f29-4c6f-adc1-1048b2a8845cListener (260) | CJob | updateFailedJob(com.vmware.vcloud.ap
i.presentation.service.InternalServerErrorException) with locale=null |
com.vmware.vcloud.api.presentation.service.InternalServerErrorException: Internal Server Error
at com.vmware.vcloud.vimproxy.internal.impl.VcUpdateListenerImpl.onOuterLoopBreakWithException(VcUpdateListenerImpl.java:721)
at com.vmware.vcloud.vimproxy.internal.impl.VcUpdateListenerImpl.outerWaitForUpdatesLoop(VcUpdateListenerImpl.java:633)
at com.vmware.vcloud.vimproxy.internal.impl.VcUpdateListenerImpl.run(VcUpdateListenerImpl.java:343)
Caused by: org.hibernate.exception.GenericJDBCException: could not execute query
at org.hibernate.exception.SQLStateConverter.handledNonSpecificException(SQLStateConverter.java:126)
at org.hibernate.exception.SQLStateConverter.convert(SQLStateConverter.java:114)
at org.hibernate.exception.JDBCExceptionHelper.convert(JDBCExceptionHelper.java:66)
at org.hibernate.loader.Loader.doList(Loader.java:2231)
at org.hibernate.loader.Loader.listIgnoreQueryCache(Loader.java:2125)
at org.hibernate.loader.Loader.list(Loader.java:2120)
at org.hibernate.loader.criteria.CriteriaLoader.list(CriteriaLoader.java:118)
at org.hibernate.impl.SessionImpl.list(SessionImpl.java:1596)
at org.hibernate.impl.CriteriaImpl.list(CriteriaImpl.java:306)
at com.vmware.vcloud.inventory.cache.PropertyMapDao.validateOrGet(PropertyMapDao.java:336)
at com.vmware.vcloud.inventory.cache.PropertyMapDao.bulkValidateOrGet(PropertyMapDao.java:321)
at com.vmware.vcloud.inventory.cache.PropertyMapDao.bulkValidateAndGetNewer(PropertyMapDao.java:267)
at com.vmware.vcloud.inventory.cache.InventoryCacheManagerImpl.bulkGetInternal(InventoryCacheManagerImpl.java:418)
at com.vmware.vcloud.inventory.cache.InventoryCacheManagerImpl.bulkGet(InventoryCacheManagerImpl.java:549)
at com.vmware.vcloud.inventory.impl.InventoryServiceImpl.processUpdateSet(InventoryServiceImpl.java:931)
at com.vmware.vcloud.inventory.impl.InventoryServiceImpl.access$300(InventoryServiceImpl.java:145)
at com.vmware.vcloud.inventory.impl.InventoryServiceImpl$5.run(InventoryServiceImpl.java:860)
at com.vmware.vcloud.inventory.impl.InventoryServiceImpl$5.run(InventoryServiceImpl.java:826)
at com.vmware.vcloud.common.persist.ConversationContextExecutor.execute(ConversationContextExecutor.java:46)
at com.vmware.vcloud.inventory.impl.InventoryServiceImpl.processAndBatchUpdates(InventoryServiceImpl.java:826)
at com.vmware.vcloud.inventory.impl.InventoryServiceImpl.handleUpdate(InventoryServiceImpl.java:799)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:309)
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:89)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)
at $Proxy187.handleUpdate(Unknown Source)
at com.vmware.vcloud.vimproxy.internal.impl.VcUpdateListenerImpl.dispatchUpdates(VcUpdateListenerImpl.java:1080)
at com.vmware.vcloud.vimproxy.internal.impl.VcUpdateListenerImpl.innerWaitForUpdatesLoop(VcUpdateListenerImpl.java:925)
at com.vmware.vcloud.vimproxy.internal.impl.VcUpdateListenerImpl.outerWaitForUpdatesLoop(VcUpdateListenerImpl.java:594)
... 1 more
Caused by: java.sql.SQLException: ORA-01555: snapshot too old: rollback segment number with name "" too small
ORA-22924: snapshot too old
at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:439)
at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:388)
at oracle.jdbc.driver.T4CTTIoer.processError(T4CTTIoer.java:381)
at oracle.jdbc.driver.T4C8TTILob.processError(T4C8TTILob.java:789)
at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:436)
at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:186)
at oracle.jdbc.driver.T4C8TTILob.read(T4C8TTILob.java:146)
at oracle.jdbc.driver.T4CConnection.getBytes(T4CConnection.java:2313)
at oracle.sql.BLOB.getBytes(BLOB.java:319)
at oracle.sql.BLOB.getBytes(BLOB.java:209)
at oracle.jdbc.driver.T4CBlobAccessor.getBytes(T4CBlobAccessor.java:464)
at oracle.jdbc.driver.OracleResultSetImpl.getBytes(OracleResultSetImpl.java:676)
at oracle.jdbc.driver.OracleResultSet.getBytes(OracleResultSet.java:398)
at org.hibernate.type.AbstractBynaryType.get(AbstractBynaryType.java:101)
at org.hibernate.type.NullableType.nullSafeGet(NullableType.java:184)
at org.hibernate.type.NullableType.nullSafeGet(NullableType.java:173)
at org.hibernate.type.AbstractType.hydrate(AbstractType.java:105)
at org.hibernate.persister.entity.AbstractEntityPersister.hydrate(AbstractEntityPersister.java:2124)
at org.hibernate.loader.Loader.loadFromResultSet(Loader.java:1404)
at org.hibernate.loader.Loader.instanceNotYetLoaded(Loader.java:1332)
at org.hibernate.loader.Loader.getRow(Loader.java:1230)
at org.hibernate.loader.Loader.getRowFromResultSet(Loader.java:603)
at org.hibernate.loader.Loader.doQuery(Loader.java:724)
at org.hibernate.loader.Loader.doQueryAndInitializeNonLazyCollections(Loader.java:259)
at org.hibernate.loader.Loader.doList(Loader.java:2228)
... 32 more
2013-05-15 17:47:44,774 | DEBUG | 23b4fe43-1f29-4c6f-adc1-1048b2a8845cListener (260) | JobString | Job object - Object : cloudvcs0(com.
vmware.vcloud.entity.vimserver:23b4fe43-1f29-4c6f-adc1-1048b2a8845c) operation name: JOB_VC_START_CONNECTION |
2013-05-15 17:47:44,842 | DEBUG | 23b4fe43-1f29-4c6f-adc1-1048b2a8845cListener (260) | CJob | No last pending job : [cloudvcs0(c
om.vmware.vcloud.entity.vimserver:23b4fe43-1f29-4c6f-adc1-1048b2a8845c)], status=[3] |
2013-05-15 17:47:44,846 | DEBUG | 23b4fe43-1f29-4c6f-adc1-1048b2a8845cListener (260) | CJob | Update last job : [cloudvcs0(c
om.vmware.vcloud.entity.vimserver:23b4fe43-1f29-4c6f-adc1-1048b2a8845c)], status=[3], [5/15/13 5:47 PM] |
2013-05-15 17:47:44,964 | DEBUG | 23b4fe43-1f29-4c6f-adc1-1048b2a8845cListener (260) | ValidationServiceImpl | Skipping queuing of validator for co
m.vmware.ssdc.backend.valeventhandler.ProviderVdcVALStateValidator validator since it is a duplicate, current validation queue length: 1 |
2013-05-15 17:47:44,966 | INFO | 23b4fe43-1f29-4c6f-adc1-1048b2a8845cListener (260) | InventoryServiceImpl | Received listener stopped for VC 23b
4fe43-1f29-4c6f-adc1-1048b2a8845c |
2013-05-15 17:47:44,966 | WARN | 23b4fe43-1f29-4c6f-adc1-1048b2a8845cListener (260) | InventoryRecordPurger | Inventory records purger for 23b4fe4
3-1f29-4c6f-adc1-1048b2a8845c is not active |
2013-05-15 17:47:44,968 | INFO | 23b4fe43-1f29-4c6f-adc1-1048b2a8845cListener (260) | VcUpdateListenerImpl | Releasing the ownership of VC proxy
23b4fe43-1f29-4c6f-adc1-1048b2a8845c |
2013-05-15 17:47:44,968 | INFO | 23b4fe43-1f29-4c6f-adc1-1048b2a8845cListener (260) | VcUpdateListenerImpl | trying to clear cell instance id on
vc 23b4fe43-1f29-4c6f-adc1-1048b2a8845c (current number of retries 0). |
2013-05-15 17:47:44,969 | INFO | 23b4fe43-1f29-4c6f-adc1-1048b2a8845cListener (260) | VcUpdateListenerImpl | VC 23b4fe43-1f29-4c6f-adc1-1048b2a88
45c: Attempt to set cell instance id from 70 to 0 |
Caused by: java.sql.SQLException: ORA-01555: snapshot too old: rollback segment number with name "" too small
ORA-22924: snapshot too old
I found these two articles in the KB:
I added more space to the undo tablespace, new redologs, also change the retention parameter for all the lobs in the vCloud Scheme without any different result.
Does anyone has an idea about this?
Best regards,