Christopher Wood wrote: > On Thu, Mar 25, 2010 at 11:59:31AM -0600, Rich Megginson wrote: > >> Christopher Wood wrote: >> >>> I'm having another issue that I'm not making headway on. This time, I can't import a single value into one attribute in my directory. The attribute in question is a DirectoryString . (Previously it was an IA5String and I had issues with many values, but I changed it to DirectoryString and now only this entry is giving me trouble.) >>> >>> >>> Question: >>> >>> What troubleshooting steps can I use to identify the portion of the user-supplied string that is causing the "value #0 invalid per syntax" error? >>> >>> >>> Here's the error I get from ldapmodify: >>> >>> modifying entry "ldapAuthControlCode=1234567, ou=UsersByControlCode, o=mycompany" >>> ldap_modify: Invalid syntax (21) >>> additional info: ldapAuthSieve: value #0 invalid per syntax >>> >>> >>> Here's the schema for ldapAuthSieve from /opt/dirsrv/etc/dirsrv/slapd-cwlab-02/schema/99user.ldif: >>> >>> attributeTypes: ( 1.3.6.1.4.1.2805.1.1.1.1.36 NAME 'ldapAuthSieve' DESC 'The v >>> acation message subject line' SYNTAX 1.3.6.1.4.1.1466.115.121.1.15 SINGLE-VA >>> LUE X-ORIGIN 'user defined' ) >>> >>> >>> Points: >>> >>> The value I'm having trouble with is base64 encoded. >>> >>> The text inside the base64 encoding is bilingual English/French. It at least displays fine in my xterm. >>> >>> >> value #0 invalid per syntax with DirectoryString syntax values usually >> means the value is not a valid utf-8 encoded string. >> >>> I can ldapmodify this attribute in this entry with other base64-encoded strings. >>> >>> >> Can you give an example of an LDIF that works with ldapmodify and one >> that fails with ldapmodify? >> > > I've narrowed it down to three characters (àôç), where if I include those in my base64 encoded string I get "#0 invalid per syntax". If I use each individually as the only value in my base64-encoded string, I get the same error. > Right. They are not utf-8 encoded, probably latin-1. python >>> foo = 'àôç' >>> foo '\xc3\xa0\xc3\xb4\xc3\xa7' >>> bar = u'àôç' >>> bar u'\xe0\xf4\xe7' > By contrast, if I use [A-Za-z0-9] characters only (base64-encoded) in my value then the ldap value is modified without any difficulties. I haven't tested with every single other character, so there may be more that cause this error. > The 7-bit ascii character set is essentially utf-8, so 7-bit ascii characters always validate as valid utf-8 characters. > I'm a bit confused as to why this happens. I thought the point of base64-encoding was that we could stuff arbitrary strings in? No, you can't get around syntax validation by base64 encoding. However, many LDAP clients are capable of converting latin-1 characters to utf-8. It could be that because it is base64 encoded, your LDAP client cannot automatically convert the values to utf-8. > Or does the fact that they're not UTF8 affect the encoding? > Yes. > Is there a way to ensure that these values will be translated to an appropriate encoding in the initialization and replication process? > You have to convert them to utf-8 before storing in LDAP. Once in LDAP, LDAP will just pass around the values as utf-8. It is up to the clients to convert the utf-8 to something "human readable". > >>> I can ldapmodify this attribute in this entry with a much longer base64-encoded string, so I'm fairly sure I haven't hit a limit on the number of characters. >>> >>> >> I don't think it is a limit on the number of characters that is causing >> the problem. >> >>> Error log output with debug level of 1 when I was running ldapmodify: >>> >>> >>> [25/Mar/2010:13:23:04 -0400] - reslimit_update_from_entry(): setting limit for handle 1 (based on nsSizeLimit) >>> [25/Mar/2010:13:23:04 -0400] - reslimit_update_from_entry(): setting limit for handle 2 (based on nsTimeLimit) >>> [25/Mar/2010:13:23:04 -0400] - reslimit_update_from_entry(): setting limit for handle 3 (based on nsIdleTimeout) >>> [25/Mar/2010:13:23:04 -0400] - <= reslimit_update_from_entry() returning status 0 >>> [25/Mar/2010:13:23:08 -0400] - ldbm backend flushing >>> [25/Mar/2010:13:23:08 -0400] - ldbm backend done flushing >>> [25/Mar/2010:13:23:08 -0400] - ldbm backend flushing >>> [25/Mar/2010:13:23:08 -0400] - ldbm backend done flushing >>> [25/Mar/2010:13:23:08 -0400] - ldbm backend flushing >>> [25/Mar/2010:13:23:08 -0400] - ldbm backend done flushing >>> [25/Mar/2010:13:23:35 -0400] - => ids_sasl_server_new (cwlab-02.pvt.primus.ca) >>> [25/Mar/2010:13:23:35 -0400] - ids_sasl_getopt: plugin= option=log_level >>> [25/Mar/2010:13:23:35 -0400] - ids_sasl_getopt: plugin= option=auto_transition >>> [25/Mar/2010:13:23:35 -0400] - <= ids_sasl_server_new >>> [25/Mar/2010:13:23:35 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e7248, handle=3 >>> [25/Mar/2010:13:23:35 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:35 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e7188, handle=3 >>> [25/Mar/2010:13:23:35 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:35 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e7008, handle=3 >>> [25/Mar/2010:13:23:35 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:35 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e70c8, handle=3 >>> [25/Mar/2010:13:23:35 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:35 -0400] - add_pb >>> [25/Mar/2010:13:23:35 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e7188, handle=3 >>> [25/Mar/2010:13:23:35 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:35 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e7008, handle=3 >>> [25/Mar/2010:13:23:35 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:35 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e70c8, handle=3 >>> [25/Mar/2010:13:23:35 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:35 -0400] - get_pb >>> [25/Mar/2010:13:23:35 -0400] - do_bind >>> [25/Mar/2010:13:23:35 -0400] - BIND dn="cn=Directory Manager" method=128 version=3 >>> [25/Mar/2010:13:23:35 -0400] - => get_ldapmessage_controls >>> [25/Mar/2010:13:23:35 -0400] - <= get_ldapmessage_controls no controls >>> [25/Mar/2010:13:23:35 -0400] - => slapi_control_present (looking for 2.16.840.1.113730.3.4.16) >>> [25/Mar/2010:13:23:35 -0400] - <= slapi_control_present 0 (NO CONTROLS) >>> [25/Mar/2010:13:23:35 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e7248, handle=3 >>> [25/Mar/2010:13:23:35 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:35 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e7188, handle=3 >>> [25/Mar/2010:13:23:35 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:35 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e7008, handle=3 >>> [25/Mar/2010:13:23:35 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:35 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e70c8, handle=3 >>> [25/Mar/2010:13:23:35 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:35 -0400] - do_bind: version 3 method 0x80 dn cn=Directory Manager >>> [25/Mar/2010:13:23:35 -0400] - => slapi_pw_find value: "password" >>> [25/Mar/2010:13:23:35 -0400] - <= slapi_pw_find matched "cGFzc3dvcmQK" using scheme "SSHA" >>> [25/Mar/2010:13:23:35 -0400] - => send_ldap_result 0:: >>> [25/Mar/2010:13:23:35 -0400] - <= send_ldap_result >>> [25/Mar/2010:13:23:38 -0400] - ldbm backend flushing >>> [25/Mar/2010:13:23:38 -0400] - ldbm backend done flushing >>> [25/Mar/2010:13:23:38 -0400] - ldbm backend flushing >>> [25/Mar/2010:13:23:38 -0400] - ldbm backend done flushing >>> [25/Mar/2010:13:23:38 -0400] - ldbm backend flushing >>> [25/Mar/2010:13:23:38 -0400] - ldbm backend done flushing >>> [25/Mar/2010:13:23:48 -0400] - add_pb >>> [25/Mar/2010:13:23:48 -0400] - get_pb >>> [25/Mar/2010:13:23:48 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e7188, handle=3 >>> [25/Mar/2010:13:23:48 -0400] - do_modify >>> [25/Mar/2010:13:23:48 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:48 -0400] - => get_ldapmessage_controls >>> [25/Mar/2010:13:23:48 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e7008, handle=3 >>> [25/Mar/2010:13:23:48 -0400] - <= get_ldapmessage_controls no controls >>> [25/Mar/2010:13:23:48 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:48 -0400] - => slapi_reslimit_get_integer_limit() conn=0x0, handle=2 >>> [25/Mar/2010:13:23:48 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e70c8, handle=3 >>> [25/Mar/2010:13:23:48 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:48 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:48 -0400] - => slapi_reslimit_get_integer_limit() conn=0x0, handle=1 >>> [25/Mar/2010:13:23:48 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:48 -0400] - => compute_limits: sizelimit=-1, timelimit=-1 >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'ACL preoperation' #1 type 403 >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'deref' #2 type 403 >>> [25/Mar/2010:13:23:48 -0400] deref-plugin - --> deref_pre_search >>> [25/Mar/2010:13:23:48 -0400] deref-plugin - <-- deref_pre_op >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'Legacy replication preoperation plugin' #4 type 403 >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'Multimaster replication preoperation plugin' #6 type 403 >>> [25/Mar/2010:13:23:48 -0400] - => slapi_reslimit_get_integer_limit() conn=0x0, handle=0 >>> [25/Mar/2010:13:23:48 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:48 -0400] - => find_entry_internal (dn=ldapauthcontrolcode=1234567,ou=usersbycontrolcode,o=mycompany) lock 0 >>> [25/Mar/2010:13:23:48 -0400] - => dn2entry "ldapauthcontrolcode=1234567,ou=usersbycontrolcode,o=mycompany" >>> [25/Mar/2010:13:23:48 -0400] - <= dn2entry 9b6fd490 >>> [25/Mar/2010:13:23:48 -0400] - <= find_entry_internal_dn found (ldapauthcontrolcode=1234567,ou=usersbycontrolcode,o=mycompany) >>> [25/Mar/2010:13:23:48 -0400] - candidate list has 1 ids >>> [25/Mar/2010:13:23:48 -0400] id2entry - => id2entry(633364) >>> [25/Mar/2010:13:23:48 -0400] id2entry - <= id2entry 9b6fd490, dn "ldapauthcontrolcode=1234567,ou=usersbycontrolcode,o=mycompany" (cache) >>> [25/Mar/2010:13:23:48 -0400] - => send_ldap_search_entry (ldapAuthControlCode=1234567, ou=UsersByControlCode, o=mycompany) >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'deref' #2 type 410 >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'Legacy replication preoperation plugin' #4 type 410 >>> [25/Mar/2010:13:23:48 -0400] - <= send_ldap_search_entry >>> [25/Mar/2010:13:23:48 -0400] - => send_ldap_result 0:: >>> [25/Mar/2010:13:23:48 -0400] - <= send_ldap_result >>> [25/Mar/2010:13:23:48 -0400] - modify_update_last_modified_attr >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin '7-bit check' #0 type 405 >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'ACL preoperation' #1 type 405 >>> [25/Mar/2010:13:23:48 -0400] - => slapi_control_present (looking for 2.16.840.1.113730.3.4.12) >>> [25/Mar/2010:13:23:48 -0400] - <= slapi_control_present 0 (NO CONTROLS) >>> [25/Mar/2010:13:23:48 -0400] - => slapi_control_present (looking for 2.16.840.1.113730.3.4.18) >>> [25/Mar/2010:13:23:48 -0400] - <= slapi_control_present 0 (NO CONTROLS) >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'Legacy replication preoperation plugin' #4 type 405 >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'Linked Attributes' #5 type 405 >>> [25/Mar/2010:13:23:48 -0400] linkedattrs-plugin - --> linked_attrs_pre_op >>> [25/Mar/2010:13:23:48 -0400] linkedattrs-plugin - --> linked_attrs_get_dn >>> [25/Mar/2010:13:23:48 -0400] linkedattrs-plugin - <-- linked_attrs_get_dn >>> [25/Mar/2010:13:23:48 -0400] linkedattrs-plugin - --> linked_attrs_dn_is_config >>> [25/Mar/2010:13:23:48 -0400] linkedattrs-plugin - <-- linked_attrs_dn_is_config >>> [25/Mar/2010:13:23:48 -0400] linkedattrs-plugin - <-- linked_attrs_pre_op >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'Multimaster replication preoperation plugin' #6 type 405 >>> [25/Mar/2010:13:23:48 -0400] - => find_entry_internal (dn=ldapauthcontrolcode=1234567,ou=usersbycontrolcode,o=mycompany) lock 1 >>> [25/Mar/2010:13:23:48 -0400] - => dn2entry "ldapauthcontrolcode=1234567,ou=usersbycontrolcode,o=mycompany" >>> [25/Mar/2010:13:23:48 -0400] - <= dn2entry 9b6fd490 >>> [25/Mar/2010:13:23:48 -0400] - <= find_entry_internal_dn found (ldapauthcontrolcode=1234567,ou=usersbycontrolcode,o=mycompany) >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'Multimaster replication bepreoperation plugin' #0 type 451 >>> [25/Mar/2010:13:23:48 -0400] - => entry_apply_mods_wsi >>> [25/Mar/2010:13:23:48 -0400] - <= entry_apply_mods_wsi 0 >>> [25/Mar/2010:13:23:48 -0400] - => send_ldap_result 21::ldapAuthSieve: value #0 invalid per syntax >>> >>> [25/Mar/2010:13:23:48 -0400] - <= send_ldap_result >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'Retrocl postoperation plugin' #0 type 505 >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'Class of Service postoperation plugin' #1 type 505 >>> [25/Mar/2010:13:23:48 -0400] - --> cos_post_op >>> [25/Mar/2010:13:23:48 -0400] - --> cos_cache_change_notify >>> [25/Mar/2010:13:23:48 -0400] - <-- cos_cache_change_notify >>> [25/Mar/2010:13:23:48 -0400] - <-- cos_post_op >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'Distributed Numeric Assignment postop plugin' #2 type 505 >>> [25/Mar/2010:13:23:48 -0400] dna-plugin - --> dna_config_check_post_op >>> [25/Mar/2010:13:23:48 -0400] dna-plugin - --> dna_get_dn >>> [25/Mar/2010:13:23:48 -0400] dna-plugin - <-- dna_get_dn >>> [25/Mar/2010:13:23:48 -0400] dna-plugin - --> dna_is_config >>> [25/Mar/2010:13:23:48 -0400] dna-plugin - <-- dna_is_config >>> [25/Mar/2010:13:23:48 -0400] dna-plugin - <-- dna_config_check_post_op >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'Legacy replication postoperation plugin' #3 type 505 >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'Linked Attributes postop plugin' #4 type 505 >>> [25/Mar/2010:13:23:48 -0400] linkedattrs-plugin - --> linked_attrs_mod_post_op >>> [25/Mar/2010:13:23:48 -0400] linkedattrs-plugin - --> linked_attrs_oktodo >>> [25/Mar/2010:13:23:48 -0400] linkedattrs-plugin - <-- linked_attrs_oktodo >>> [25/Mar/2010:13:23:48 -0400] linkedattrs-plugin - <-- linked_attrs_mod_post_op >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'Multimaster replication postoperation plugin' #5 type 505 >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'Roles postoperation plugin' #6 type 505 >>> [25/Mar/2010:13:23:48 -0400] - Calling plugin 'State Change Plugin' #7 type 505 >>> [25/Mar/2010:13:23:48 -0400] statechange-plugin - --> statechange_post_op >>> [25/Mar/2010:13:23:48 -0400] statechange-plugin - <-- statechange_post_op >>> [25/Mar/2010:13:23:48 -0400] - do_unbind >>> [25/Mar/2010:13:23:48 -0400] - => get_ldapmessage_controls >>> [25/Mar/2010:13:23:48 -0400] - <= get_ldapmessage_controls no controls >>> [25/Mar/2010:13:23:48 -0400] - defbackend_noop >>> [25/Mar/2010:13:23:48 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e7188, handle=3 >>> [25/Mar/2010:13:23:48 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:48 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e7008, handle=3 >>> [25/Mar/2010:13:23:48 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:48 -0400] - => slapi_reslimit_get_integer_limit() conn=0xb01e70c8, handle=3 >>> [25/Mar/2010:13:23:48 -0400] - <= slapi_reslimit_get_integer_limit() returning NO VALUE >>> [25/Mar/2010:13:23:48 -0400] - => reslimit_update_from_entry() conn=0xb01e7248, entry=0x0 >>> [25/Mar/2010:13:23:48 -0400] - reslimit_update_from_entry(): setting limit for handle 0 (based on nsLookThroughLimit) >>> [25/Mar/2010:13:23:48 -0400] - reslimit_update_from_entry(): setting limit for handle 1 (based on nsSizeLimit) >>> [25/Mar/2010:13:23:48 -0400] - reslimit_update_from_entry(): setting limit for handle 2 (based on nsTimeLimit) >>> [25/Mar/2010:13:23:48 -0400] - reslimit_update_from_entry(): setting limit for handle 3 (based on nsIdleTimeout) >>> [25/Mar/2010:13:23:48 -0400] - <= reslimit_update_from_entry() returning status 0 >>> -- >>> 389 users mailing list >>> 389-users@xxxxxxxxxxxxxxxxxxxxxxx >>> https://admin.fedoraproject.org/mailman/listinfo/389-users >>> >>> >> -- >> 389 users mailing list >> 389-users@xxxxxxxxxxxxxxxxxxxxxxx >> https://admin.fedoraproject.org/mailman/listinfo/389-users >> > -- > 389 users mailing list > 389-users@xxxxxxxxxxxxxxxxxxxxxxx > https://admin.fedoraproject.org/mailman/listinfo/389-users > -- 389 users mailing list 389-users@xxxxxxxxxxxxxxxxxxxxxxx https://admin.fedoraproject.org/mailman/listinfo/389-users
